-- Logs begin at Mon 2022-06-20 11:32:12 UTC, end at Mon 2022-06-20 12:50:44 UTC. -- Jun 20 12:07:19.697506 dv-cinder-836973-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 12:07:19.706993 dv-cinder-836973-4-smb devstack@keystone.service[80286]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 12:07:19 2022] *** Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: nodename: dv-cinder-836973-4-smb Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: machine: x86_64 Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: clock source: unix Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: pcre jit disabled Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: detected number of CPU cores: 4 Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: current working directory: / Jun 20 12:07:19.709064 dv-cinder-836973-4-smb devstack@keystone.service[80286]: detected binary path: /usr/bin/uwsgi-core Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: your processes number limit is 47680 Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: your memory page size is 4096 bytes Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: detected max file descriptor number: 2048 Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: lock engine: pthread robust mutexes Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: thunder lock: enabled Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 12:07:19.709742 dv-cinder-836973-4-smb devstack@keystone.service[80286]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 12:07:19.754489 dv-cinder-836973-4-smb devstack@keystone.service[80286]: Python main interpreter initialized at 0x55df8613a9c0 Jun 20 12:07:19.754489 dv-cinder-836973-4-smb devstack@keystone.service[80286]: python threads support enabled Jun 20 12:07:19.754489 dv-cinder-836973-4-smb devstack@keystone.service[80286]: your server socket listen backlog is limited to 100 connections Jun 20 12:07:19.754489 dv-cinder-836973-4-smb devstack@keystone.service[80286]: your mercy for graceful operations on workers is 90 seconds Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: *** Operational MODE: preforking *** Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: *** uWSGI is running in multiple interpreter mode *** Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: spawned uWSGI master process (pid: 80286) Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: spawned uWSGI worker 1 (pid: 80295, cores: 1) Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: spawned uWSGI worker 2 (pid: 80296, cores: 1) Jun 20 12:07:19.764379 dv-cinder-836973-4-smb devstack@keystone.service[80286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 12:07:19.755337 dv-cinder-836973-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 20 12:07:25.281312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:07:25.281312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Jun 20 12:07:25.282142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:07:25.282142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Jun 20 12:07:25.316582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:07:25.316582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: from cryptography.utils import int_from_bytes Jun 20 12:07:25.317086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:07:25.317086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: from cryptography.utils import int_from_bytes Jun 20 12:07:25.330758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:07:25.330969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:07:25.331166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] command line args: [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:07:25.331445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:07:25.331627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ================================================================================ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:07:25.331884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.332130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config_dir = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.332324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.332509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config_source = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.332692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] debug = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.332895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.333325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.333530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.333750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.334186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.334273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.334435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_config_append = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.334617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.334821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_dir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.334985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.335759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.336008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.336260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.336511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.336690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.336862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.337094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.337344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.337580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.337816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.338075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.338312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.338561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.338809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.339084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.339581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.339768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] publish_errors = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.340004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.340240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.340460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.340670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.340907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.341142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] standard_threads = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.341375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.341619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.341799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.341979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_journal = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_json = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_stderr = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_syslog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.348793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.350286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.350286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.350409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.350662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.350941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.351184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.351437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.351673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.351915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.352154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.352387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.352622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.352857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.353094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.353333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.353584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.353820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.354083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.354329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.354570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.354808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.355058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.355291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.355531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.355775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.356015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.356253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.356492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.356725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.356976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.357216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.357472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.357709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.357974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.358236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.358473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.358714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.358953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.359225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.359477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.359758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.360007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.360245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.360483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.360720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.360970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.361209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.361447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.361692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.361930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.362195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.362433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.362671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.362907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.363169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.363411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.363654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.363895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.364139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.364220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:07:25.364339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:07:25.364457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.364546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] command line args: [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:07:25.364617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.364797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:07:25.364879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.364980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ================================================================================ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:07:25.365056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.365238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] admin_token = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.365314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.365556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] config_dir = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.365712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.365793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.365909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] config_source = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.365984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.366125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] debug = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.366202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.366345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.366457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.366618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.366693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.366802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.366905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.367060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.367146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.367313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.367408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.367548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.367652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.367727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_config_append = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.367888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.external = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.367994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.368072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_dir = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.368150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.368231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.368404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.368492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.368639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.368720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.368875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.password = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.368979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.369108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.token = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.369219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.369317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.369415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.369521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.369625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.369727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.369823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.369947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.370064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.370214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.370302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.370453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.370530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.370691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.370776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.371179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.371312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.371312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.371474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.371599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.371681 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.371752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.371872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.371947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.372144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.372223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.372381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.372459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] publish_errors = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.372617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.372695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.372856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.372935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.373047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.373127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.373279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.373360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.373520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.373617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.373767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] standard_threads = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.373849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.374049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.374144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.374280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.374362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.374483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.374616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.374731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] use_journal = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.374848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] use_json = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.374920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.374995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] use_stderr = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.375087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.375173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] use_syslog = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.375336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.375419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:07:25.375585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.375662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.375825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.375950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.376888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.377853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.378845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.379995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.380941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.381927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.382571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.382716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.382801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.383643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.383750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.383852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.383937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.383937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.384936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.385983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.386958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.387983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.388958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.389904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.390862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.391987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.392999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.393957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.394973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.395928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.396903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.397059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.397137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.397302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.397378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.397541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.397616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.398379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.398472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.398606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.398685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.398839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.398962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.399893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.400998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.401874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.external = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.password = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.402990 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.token = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.403952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.404927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.405981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.406969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.407998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.408968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.409919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.410120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.410206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.410279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.410426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.410581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.410660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.417962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.418995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.419932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.420939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.421939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.422905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.423913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.424157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.424405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.424672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.424910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.425164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.425417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.425671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.425911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.426171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.426412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.426653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.426895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.427130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.427382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.427635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.427886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.428138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.428425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.428673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.429440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.429685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.429927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.430194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.430435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.430688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.430943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.431185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.431445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.431681 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.431930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.432169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.432408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.432649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.432902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.433147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.433385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.433627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.433902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.434229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.434485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.434728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.434982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.435237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.435477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.435729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.435970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.436213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.436451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] role.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.436704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] role.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.436948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.437202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.437454 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.437708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.437960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.438239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.441981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.442263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.442521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.442767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.443007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.443244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.443482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.443740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.444003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.444263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.444840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.444840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.445028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.445270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.445512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.445765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.446022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.446288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.446543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.446786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.447036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.447355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.447589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.447829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.448072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.448313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.448564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.448818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.449051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.449298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.449601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.449866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.450145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.450400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.450641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.450887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.450966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.451129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.451207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.451364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.451490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.451601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.451842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.452093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.452337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.452624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.452873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.453127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.453413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.453664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.453903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.454171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.454413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:07:25.454589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:07:25.459955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.481736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.481972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.486993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.488773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.489009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.490792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.509130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.509361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.642789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.652755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.692422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.692651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.697648 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.697886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.759966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.760946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.761079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.761170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.761340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.761531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.790669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.790903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.791958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.792039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.792177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.792397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.803181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.803338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.818522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.818641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.818758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.818923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.819966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:07:25.836961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.837069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.837234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:07:25.837299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:07:25.837505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.837601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.837709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:07:25.837792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:07:25.837978 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.838867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.849603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.849880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.850140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.850227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.850422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.850520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.850693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.851513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.859424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.859770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.862734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.863015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.863099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.863300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.863384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.863584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.863747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.863867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.864980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.865176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.865259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.865440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.865521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.865713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.865986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.892595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.893393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.894224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.894508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.895027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.895309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.899859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.900249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.900532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.900724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.901015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.901330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.907864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.908203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.908760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.909044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.912951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.913236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.914062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.914347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.914563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.914662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.914855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.914940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.915135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.915226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.915400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.915491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.915671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.915948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.916218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.916487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.934193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.934474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.939444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.939538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.939841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.943095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.943494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.948277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.949080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.952731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.954471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.954774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.958546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.959046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.959521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.959914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.960000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.960984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.961392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.965458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.971199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.971506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.971797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.972098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.972381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.972665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.984715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.985005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.985273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.985550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.993529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.995279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.995560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.998797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:25.999079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.999375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.999639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:25.999937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.001731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.002295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.002716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.003122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.013804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.014114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.014406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.014689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.016371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.016665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.016891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.016985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.019108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.019514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.024720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.025139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.025548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.025956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.026395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.035432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.039069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.042401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.044133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.045208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.045489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.045773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.045857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.046074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.046160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.046354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.046439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.046628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.046910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.053650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.055303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.058571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.058864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.059255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.059535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.066395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.068681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.068969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.069258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.070239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.073563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.075198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.076848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.077130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.077416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.077662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.077940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.078246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.078523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.078794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.079171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.079464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.079733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.080013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.080292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.080564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.080837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.081102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.081374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.084905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.087219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.090519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.090813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.091101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.091381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.100696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.102198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.103277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.114552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:07:26.114844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.115127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.115407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.115683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.115979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.116270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.116572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.116845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.117242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.117713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.118038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.118308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.118584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:07:26.121968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55df8613a9c0 pid: 80296 (default app) Jun 20 12:07:26.125503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a7ac-f7fd-4776-9998-628ddb47afe6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:26.125801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a7ac-f7fd-4776-9998-628ddb47afe6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:26.126105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a7ac-f7fd-4776-9998-628ddb47afe6 None None] PATH_INFO: `/v3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:26.130294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Mon Jun 20 12:07:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:26.157835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55df8613a9c0 pid: 80295 (default app) Jun 20 12:07:35.091386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.091966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.091966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.093285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:07:35.100954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.101358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.101511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.171566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: INFO dbcounter [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] Registered counter for database keystone Jun 20 12:07:35.192381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG oslo_db.sqlalchemy.engines [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:07:35.198550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writer thread running {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:07:35.373480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG passlib.handlers.bcrypt [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80295) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 12:07:35.373805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG passlib.handlers.bcrypt [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80295) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 12:07:35.428032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:35.429613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:35.549361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1/3] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 20 12:07:35.715013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.785784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: INFO dbcounter [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] Registered counter for database keystone Jun 20 12:07:35.804921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG oslo_db.sqlalchemy.engines [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:07:35.811230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writer thread running {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:07:35.930220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f2ab9-2ade-4986-9727-f65ef40638eb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.935064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.935728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.936017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.936297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.944482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:35.996586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 12:07:35.996882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034f43e-25d5-4d03-a8d9-46e559d4b7f1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.006456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 12:07:36.012957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:36.027417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da93e3-41b9-4040-8333-29de79aee232 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:36.031798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:36.032911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:36.033199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:36.033476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] PATH_INFO: `/v3/projects/5236866843c24c419599ba663dbbb1be` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.038146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] RBAC: Authorizing `identity:get_project(project_id=5236866843c24c419599ba663dbbb1be)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.089145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING keystone.common.rbac_enforcer.enforcer [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 12:07:36.089488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a7a6-b43d-4a40-acc3-0bdfb9780164 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.094051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 2/5] 10.222.0.70 () {56 vars in 1207 bytes} [Mon Jun 20 12:07:36 2022] GET /identity/v3/projects/5236866843c24c419599ba663dbbb1be => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:38.173218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda15ae6-6476-4de8-a035-f80c5aaf5558 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:38.180292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda15ae6-6476-4de8-a035-f80c5aaf5558 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:38.180292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda15ae6-6476-4de8-a035-f80c5aaf5558 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:38.180816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 4/6] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:38.189753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:38.190261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:38.190346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:38.211634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:38.213174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:38.221195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 3/7] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 12:07:38.248241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda15ae6-6476-4de8-a035-f80c5aaf5558 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:38.260865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda15ae6-6476-4de8-a035-f80c5aaf5558 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:38.265083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a5523-8efc-4cb1-8b7c-03f933ad62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:38.265723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a5523-8efc-4cb1-8b7c-03f933ad62f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:38.266092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a5523-8efc-4cb1-8b7c-03f933ad62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:38.266387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a5523-8efc-4cb1-8b7c-03f933ad62f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:38.273937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a5523-8efc-4cb1-8b7c-03f933ad62f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:38.275773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a5523-8efc-4cb1-8b7c-03f933ad62f0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:38.284471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 5/8] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Jun 20 12:07:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 12:07:38.290039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:38.299209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa955-1438-4497-a1be-c0492d61f9ef None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:38.303683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570b91-7096-47e1-9aab-c2c7a36ec78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:38.304542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570b91-7096-47e1-9aab-c2c7a36ec78f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:38.304831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570b91-7096-47e1-9aab-c2c7a36ec78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:38.305111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570b91-7096-47e1-9aab-c2c7a36ec78f admin admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:38.306554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570b91-7096-47e1-9aab-c2c7a36ec78f admin admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:38.308924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570b91-7096-47e1-9aab-c2c7a36ec78f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:38.310537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 4/9] 10.222.0.70 () {56 vars in 1198 bytes} [Mon Jun 20 12:07:38 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:40.399440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e13082-3a93-4644-90f9-b52681a4235b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.399936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e13082-3a93-4644-90f9-b52681a4235b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.400100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e13082-3a93-4644-90f9-b52681a4235b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.401906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:40.407083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.407489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.407651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.425258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:40.426491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:40.456533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9e04-bd6e-466f-a6de-65f6a18000b2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.456833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9e04-bd6e-466f-a6de-65f6a18000b2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.457121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9e04-bd6e-466f-a6de-65f6a18000b2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.458681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 7/11] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:07:40.464364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.464656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.464938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.504300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80296) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 12:07:40.504746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80296) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 12:07:40.507056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 5/12] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:40.530448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:40.550908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:40.552513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:40.554100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:40.633322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889adc1b-17b2-4942-990c-316fec32e82f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:40.653312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 8/13] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:07:40.670208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:40.670998 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.671278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.671554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.679837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:40.682851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:40.694019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:40.694894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:40.695744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:07:40.698126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 6/14] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:07:40.701005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:40.782770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:40.783391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28cd93-7bfa-4677-8971-c6fc04c05b6d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:40.785753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:40.803100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62574ff6-56f4-492d-ab6f-f6c2f22ca5d7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:40.819850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:40.820755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.821045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.821325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.837461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:40.838156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.839019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.839303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.840069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:40.840378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:40.841868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:40.853710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 7/15] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:40.859250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:40.888895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:40.890460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:40.958262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f379f6-d865-4881-adfa-0d6d43146467 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:40.986109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 9/16] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:40.991855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:40.992198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:40.993060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:40.993340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:40.993615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:40.994585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:40.994845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:40.996323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:40.997940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 8/17] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:40 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:41.003296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:41.017886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:41.089042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf25e8-b1ac-440e-a867-38c769950e20 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:41.101769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e81b9-dc4c-4a8c-a127-3bbadfeb6c56 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:41.126794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:41.127590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.127873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.128315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.136258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:41.137052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.137342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.137624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.138853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:41.140330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:41.141948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:41.147849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:41.147975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:41.149347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:41.170810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:41.171810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:41.172753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:41.172753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:41.172753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:41.172753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:07:41.172753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:07:41.177751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:41.230664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:41.233220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:41.248939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09423-973a-4d76-bd01-2995a8b92ff7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:41.275104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d861bce-b9dd-4324-b744-255d18b2d2c5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:41.283220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:41.283865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.284151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.284426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.285246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.domain.id=default, user.id=59ecf7a36c4a499aaba37cd54ff4117a) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:41.289830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:41.289830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73298d9-e5c8-4a38-8e3a-f85195650cb4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:41.294061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Jun 20 12:07:41 2022] GET /identity/v3/role_assignments?user.id=59ecf7a36c4a499aaba37cd54ff4117a&scope.domain.id=default&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:41.309965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:41.311456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.311748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.312034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.312799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:41.313115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:41.314627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c55e53-ae63-4a28-a2e8-9d4a25dbd89a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:41.335051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:43.805161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d11f13-3604-4a4f-b6ba-0e4a290386d8 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:43.806210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d11f13-3604-4a4f-b6ba-0e4a290386d8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:43.806726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d11f13-3604-4a4f-b6ba-0e4a290386d8 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:43.808411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:43.814110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d303-7bab-4b2b-bd80-c58da67188dc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:43.814951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d303-7bab-4b2b-bd80-c58da67188dc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:43.815430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d303-7bab-4b2b-bd80-c58da67188dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:43.839546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4f25d303-7bab-4b2b-bd80-c58da67188dc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:43.841084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4f25d303-7bab-4b2b-bd80-c58da67188dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:43.854661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef865-a46f-4687-b022-d9d3cb1a6f05 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:43.855251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef865-a46f-4687-b022-d9d3cb1a6f05 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:43.855728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef865-a46f-4687-b022-d9d3cb1a6f05 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:43.857305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 12/23] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:07:43.862458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:43.862955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:43.863436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:43.890790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:43.892503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:43.983372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:43.985055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696051-949c-4a40-9961-b10fae68178a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:43.985547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696051-949c-4a40-9961-b10fae68178a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:43.986041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696051-949c-4a40-9961-b10fae68178a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:43.987519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 13/25] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:43.992715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:43.993234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:43.993711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.016483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 13/26] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:07:44.027822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:44.029044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:44.031301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.130474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.173963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.181721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 14/27] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:07:44.183197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.224602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2cf8c-44f2-4b6f-8121-7deecb061839 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.292533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.293334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.293621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.293903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.317535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:44.325960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:44.326822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:44.327662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:07:44.339327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 14/28] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:07:44.340212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.371308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdb90-5294-4dcd-a152-0bc0777b6ab6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.435558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.436373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.436664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.436947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.455145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.456656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:44.475237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:44.476097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:44.476899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:44.476899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:44.476899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:44.476899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:07:44.476899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 15/29] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:44.477591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.513104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af355b-3116-4396-a92a-b23776d4268c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.525495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.561872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daa542-3cbe-4fad-bbc8-1147b71cbc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.562917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa542-3cbe-4fad-bbc8-1147b71cbc97 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.563393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa542-3cbe-4fad-bbc8-1147b71cbc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.563866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa542-3cbe-4fad-bbc8-1147b71cbc97 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.564852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daa542-3cbe-4fad-bbc8-1147b71cbc97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.566491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daa542-3cbe-4fad-bbc8-1147b71cbc97 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.569646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.610433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e13b9-e975-4722-af07-a99ba120ae45 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.645408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.646040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.646336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.646617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.647375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:44.647688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.649084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.663203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 16/30] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:44.664113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.763761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.777331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c427-a387-4bdc-9218-2242c0521a0d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.809372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 15/31] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jun 20 12:07:44 2022] POST /identity/v3/roles => generated 219 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:44.810986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e661-0dcf-4f7c-b7bd-947cf53b5dee None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.811288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e661-0dcf-4f7c-b7bd-947cf53b5dee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.811662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e661-0dcf-4f7c-b7bd-947cf53b5dee None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.813132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 16/32] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:44.813728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e661-0dcf-4f7c-b7bd-947cf53b5dee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.819394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.820713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.821194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.821663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.822692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:44.823234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.825548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd8d9d-dcab-4327-b9f9-82b034c044e0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.845255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 17/33] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:44.847100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2526f-b374-4726-b0c3-bba6be9fae6a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.847593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2526f-b374-4726-b0c3-bba6be9fae6a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.848087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2526f-b374-4726-b0c3-bba6be9fae6a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.849683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 18/34] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:44.851489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.852521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.852993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.875468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:44.877075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:44.961856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e661-0dcf-4f7c-b7bd-947cf53b5dee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.970720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 19/35] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:44.971427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:45.009395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb97296-bc73-48e8-8974-c67d157d9752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.011330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97296-bc73-48e8-8974-c67d157d9752 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.011818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97296-bc73-48e8-8974-c67d157d9752 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.012504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb97296-bc73-48e8-8974-c67d157d9752 None admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.014269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb97296-bc73-48e8-8974-c67d157d9752 None admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.016369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb97296-bc73-48e8-8974-c67d157d9752 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.018191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 17/36] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:45.019644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.020068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.020483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.042736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:45.044590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:45.086721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:45.108512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab046-0ea3-4690-b9d0-991fbb0e7d86 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:45.109964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:45.124549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 18/37] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:45.125167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:45.156293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.156961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.157246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.157701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.158529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.160227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.232022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db40aa9-5cba-482d-868d-dfaa2e3d8a40 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:45.265757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.266455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.266747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.267027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.267820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.269271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.361581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 19/38] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jun 20 12:07:45 2022] POST /identity/v3/roles => generated 225 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:45.362755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:45.379856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:07:44 2022] POST /identity/v3/projects => generated 301 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:45.380876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:45.457305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:45.530534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239001c-1611-4dad-8843-9b4e736ba48e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:45.548752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03304-9459-4b02-af16-b90a9b28a91a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:45.570665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab07b6e-10c8-4175-b2c9-1249a8e28918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.571472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07b6e-10c8-4175-b2c9-1249a8e28918 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.571765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07b6e-10c8-4175-b2c9-1249a8e28918 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.572047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07b6e-10c8-4175-b2c9-1249a8e28918 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.573919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab07b6e-10c8-4175-b2c9-1249a8e28918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.575472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab07b6e-10c8-4175-b2c9-1249a8e28918 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.577152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 20/40] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:45.578467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be761966-caa6-454f-bc5a-5a6b90e97543 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.578761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be761966-caa6-454f-bc5a-5a6b90e97543 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.579044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be761966-caa6-454f-bc5a-5a6b90e97543 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.581018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 21/41] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:45.585009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be761966-caa6-454f-bc5a-5a6b90e97543 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:45.591257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:45.598123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dd435-8266-4f3c-bf25-eb1ffc8b958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.599084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd435-8266-4f3c-bf25-eb1ffc8b958f None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.599374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd435-8266-4f3c-bf25-eb1ffc8b958f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.599655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd435-8266-4f3c-bf25-eb1ffc8b958f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.600427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dd435-8266-4f3c-bf25-eb1ffc8b958f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.603821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dd435-8266-4f3c-bf25-eb1ffc8b958f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.687163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jun 20 12:07:45 2022] POST /identity/v3/roles => generated 223 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:45.688553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.688922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.689142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.699127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be761966-caa6-454f-bc5a-5a6b90e97543 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:45.707621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:45.709960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:45.724567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:45.742323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.743381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.743699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.743969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] PATH_INFO: `/v3/domains/default/users/59ecf7a36c4a499aaba37cd54ff4117a/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.746349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=59ecf7a36c4a499aaba37cd54ff4117a, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.747877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.788745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:45.813148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:45.829149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 22/44] 10.222.0.70 () {58 vars in 1361 bytes} [Mon Jun 20 12:07:45 2022] PUT /identity/v3/domains/default/users/59ecf7a36c4a499aaba37cd54ff4117a/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:07:45.929881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f13c1e-5ff0-4eba-ba9b-fec94b1a09a0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:45.954284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:45.966450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf8cf-a906-49d4-8d7e-c3c819dcc901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:45.967302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf8cf-a906-49d4-8d7e-c3c819dcc901 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:45.967550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf8cf-a906-49d4-8d7e-c3c819dcc901 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:45.967823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf8cf-a906-49d4-8d7e-c3c819dcc901 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:45.969049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf8cf-a906-49d4-8d7e-c3c819dcc901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:45.970596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf8cf-a906-49d4-8d7e-c3c819dcc901 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:45.972262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 23/45] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:45.977889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:46.190200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e472c39-6088-4b0f-8dfd-9e311d211904 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:46.223669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7faf-04ec-49d2-820e-e28e1a70af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:46.224331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7faf-04ec-49d2-820e-e28e1a70af55 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:46.224622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7faf-04ec-49d2-820e-e28e1a70af55 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:46.224905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7faf-04ec-49d2-820e-e28e1a70af55 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:46.225636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d7faf-04ec-49d2-820e-e28e1a70af55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:46.227147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d7faf-04ec-49d2-820e-e28e1a70af55 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:46.321904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:07:45 2022] POST /identity/v3/projects => generated 312 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:07:47.873878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3810a-2c60-43de-9c5f-065ec3390d1d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:47.874434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3810a-2c60-43de-9c5f-065ec3390d1d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:47.874519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3810a-2c60-43de-9c5f-065ec3390d1d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:47.875882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 24/47] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:47.881189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:47.881594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:47.881769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:47.899063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:47.900268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:47.926038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:47.967879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 24/48] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:47.990885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3810a-2c60-43de-9c5f-065ec3390d1d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.094327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3810a-2c60-43de-9c5f-065ec3390d1d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.131398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.132138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.132428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.132714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.144530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:48.153352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:48.154346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:07:48.155314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 25/49] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:48.161923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.262801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d604d8-06fa-4ab8-8753-2076a3fdcdb5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.308108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.308781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.309073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.309357 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.310145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:48.310464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:48.311907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce93b9b-cf86-4269-aa57-e10e970d63f5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:48.320025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 25/50] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:48.325460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.328100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45e8d-8340-477c-9b18-7e31ba511f33 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.328394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45e8d-8340-477c-9b18-7e31ba511f33 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.328673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45e8d-8340-477c-9b18-7e31ba511f33 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.330013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 26/51] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:07:48.334863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.335160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.335446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.351392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:48.352589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:48.370405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:48.375685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:48.418639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 27/52] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:07:48.424563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e686b-6cbb-4bb1-ba2b-883dfb027ab6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.441979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.463161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.464097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.464381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.464669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.466204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:48.467710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:48.469396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:48 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:48.475089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.543546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6350e-1dc7-40e6-9655-844d7141813d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.579338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.580151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.580443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.580726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.581985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:48.583524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:48.585247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 28/54] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:48.591656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.617898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:48.679512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e944-64a4-482e-866a-fccdc0277c10 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.695294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5631683-2596-4aaa-a6d7-10f12adecc75 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.696489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:48.712925 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.714286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.714577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.718166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.718166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:48.718166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:48.719469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:48.725108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:48.729627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb32d8-3051-4bfb-a56b-bd2caf287eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.730330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb32d8-3051-4bfb-a56b-bd2caf287eae None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.730622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb32d8-3051-4bfb-a56b-bd2caf287eae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.730897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb32d8-3051-4bfb-a56b-bd2caf287eae None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.732142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb32d8-3051-4bfb-a56b-bd2caf287eae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:48.733144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb32d8-3051-4bfb-a56b-bd2caf287eae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:48.825970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d295-8f48-4740-8c29-e45734c24ce6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:48.860091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:48.860748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:48.861042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:48.861326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:48.862213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.domain.id=default, user.id=59ecf7a36c4a499aaba37cd54ff4117a) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:48.862532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:48.863982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86388783-9aff-4914-ab0b-c323bbc1423a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:48.872889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 28/56] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Jun 20 12:07:48 2022] GET /identity/v3/role_assignments?user.id=59ecf7a36c4a499aaba37cd54ff4117a&scope.domain.id=default&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:48.881761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 29/57] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Jun 20 12:07:48 2022] POST /identity/v3/projects => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:07:50.974594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17f5d-7396-496f-b82b-ba869a0a0dba None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:50.975109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17f5d-7396-496f-b82b-ba869a0a0dba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:50.975215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17f5d-7396-496f-b82b-ba869a0a0dba None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:50.976547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 29/58] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:50.981801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:50.982175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:50.982419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:50.999499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:51.000708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:51.065488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 30/59] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:51.090195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17f5d-7396-496f-b82b-ba869a0a0dba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:51.140784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:51.192597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17f5d-7396-496f-b82b-ba869a0a0dba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:51.225760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe38e3-4d9d-4487-bfbf-a5b104abbe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:51.226520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe38e3-4d9d-4487-bfbf-a5b104abbe1f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:51.226813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe38e3-4d9d-4487-bfbf-a5b104abbe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:51.227100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe38e3-4d9d-4487-bfbf-a5b104abbe1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:51.228286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe38e3-4d9d-4487-bfbf-a5b104abbe1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:51.230318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe38e3-4d9d-4487-bfbf-a5b104abbe1f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:51.231948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 30/60] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:51.237470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:51.240646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:51.333898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaa9b-8b22-4b8a-a740-0eb63d24faf1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:51.366746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecbec2-0e51-41ae-ac81-5ecfe704ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:51.367410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbec2-0e51-41ae-ac81-5ecfe704ac59 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:51.367701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbec2-0e51-41ae-ac81-5ecfe704ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:51.367986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecbec2-0e51-41ae-ac81-5ecfe704ac59 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:51.368694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecbec2-0e51-41ae-ac81-5ecfe704ac59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:51.370781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecbec2-0e51-41ae-ac81-5ecfe704ac59 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:51.464923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 31/61] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:07:51 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:54.604083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cf71-bada-4ea3-9ed9-c558fff012c9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:54.604645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cf71-bada-4ea3-9ed9-c558fff012c9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:54.604645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cf71-bada-4ea3-9ed9-c558fff012c9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:54.606032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 31/62] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:54.611408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa55f-103d-435c-b288-95901d235d3e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:54.612220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa55f-103d-435c-b288-95901d235d3e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:54.612707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa55f-103d-435c-b288-95901d235d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:54.639072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f18fa55f-103d-435c-b288-95901d235d3e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:54.640623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f18fa55f-103d-435c-b288-95901d235d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:54.710571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:54.721940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 32/63] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:54.747065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cf71-bada-4ea3-9ed9-c558fff012c9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:54.854726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cf71-bada-4ea3-9ed9-c558fff012c9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:54.872638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:54.890296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:54.891428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:54.891916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:54.892396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:54.895343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e41a1-276e-408b-bb5e-11a96a5149f9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:54.895846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e41a1-276e-408b-bb5e-11a96a5149f9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:54.896321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e41a1-276e-408b-bb5e-11a96a5149f9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:54.897933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 33/64] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:07:54.909500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287047-b38b-48a4-84e3-dc21d9496f16 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:54.910138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287047-b38b-48a4-84e3-dc21d9496f16 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:54.910628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287047-b38b-48a4-84e3-dc21d9496f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:54.923887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:54.932528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:54.933393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:07:54.934199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:07:54.941135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-29287047-b38b-48a4-84e3-dc21d9496f16 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:54.942622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-29287047-b38b-48a4-84e3-dc21d9496f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:54.944009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 32/65] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:54.952163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.042610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 34/66] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:07:55.042610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720b67-0be9-4fd7-a5ed-ffc6d01468d0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.042610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720b67-0be9-4fd7-a5ed-ffc6d01468d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.042610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720b67-0be9-4fd7-a5ed-ffc6d01468d0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.042610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 35/67] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:55.042610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8262-9f29-4155-9c4d-dbb83601e756 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.043106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8262-9f29-4155-9c4d-dbb83601e756 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.043171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8262-9f29-4155-9c4d-dbb83601e756 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.048728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 36/68] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:55.049965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.050277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.050576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.069106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:55.070474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:55.072460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a3c5b-62bc-4be5-a6c4-dc63bbac61ff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.111080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.111988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.112417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.112836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.113735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:55.114233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:55.115820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fac23-18c0-43e5-a5f5-133880f53bc5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:55.125535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 33/69] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:55.126895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.127199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.127490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.144711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:55.150190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 37/70] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:55.150335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:55.150421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.189742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.207717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.224309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 34/71] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:55.225185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.271738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223fc2-977e-47c8-a5b4-7015ce516c1e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.308910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.310254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.310760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.311267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.322173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:55.325173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2c6f-c534-4dcd-8200-2714608f56db None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:55.330585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:55.331450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:55.332266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:07:55.333154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 38/72] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:55.333761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.367290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.368091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.368386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.368661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.385285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:55.386796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:55.392878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 35/73] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:55.392878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.421789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.448356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c5d1-079b-450e-9f87-1a68ce7a7a7f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.459293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.483555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.485445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.485445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.485445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.496383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:55.504910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:55.505922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:07:55.506743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:07:55.514159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 39/74] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:55.514159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.516662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f38e-7c0e-4d68-aa36-e05c5ca463b1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.555183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.555981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.556267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.556556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.566388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:55.573968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:55.574863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:07:55.575632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 36/75] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:55.576278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.610550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed454-a57f-4f32-b3df-688d0615ba89 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.644266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.644886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.645150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.645454 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.646245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:55.646563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:55.647980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:55.656693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 40/76] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:55.657513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.663513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.675575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec1a34-6d1a-4420-9b49-5ffaefd41159 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.690339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.709126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.709878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.710206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.730058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.757530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4e2b-2a1a-489e-b408-becc01a5af61 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.776817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:55.778318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:55.792835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.793505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.793796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.794113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.794869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:55.795180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:55.796577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7ca7-1319-4d56-b8d9-6cc14e57b21f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:55.804338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 41/77] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:55.809180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bf43-0e58-4a3e-a115-1c10857efb40 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.809180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bf43-0e58-4a3e-a115-1c10857efb40 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.809180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bf43-0e58-4a3e-a115-1c10857efb40 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.809180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 42/78] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:55.809180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bf43-0e58-4a3e-a115-1c10857efb40 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.868172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.880026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 37/79] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:55.881971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.903977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:55.911600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bf43-0e58-4a3e-a115-1c10857efb40 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:55.946335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:55.946990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:55.947298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:55.947603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:55.948343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:55.948650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:55.950099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:55.958059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 43/80] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:55.958671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:55.987878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439021-7675-4507-b29a-6cc44b6a415d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.020981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e44c-cb74-4906-810d-4ae84f120fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.021859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e44c-cb74-4906-810d-4ae84f120fec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.022360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e44c-cb74-4906-810d-4ae84f120fec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.022651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e44c-cb74-4906-810d-4ae84f120fec None admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.023866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10e44c-cb74-4906-810d-4ae84f120fec None admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.025338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10e44c-cb74-4906-810d-4ae84f120fec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.027030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 38/81] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.032725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.033026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.033310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.050070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:56.051269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:56.055101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878509ac-8a61-4323-9b9a-c9ef714f460c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.088925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.089790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.090110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.090393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.091605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.093064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.094751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 44/82] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:55 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.095524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.102434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.119921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 39/83] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:56.120584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.122962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.198679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8f0d-b933-4b81-9908-90f60a598242 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.221465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb6336-c4bf-42fd-b413-0c4c6621d41c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.232345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.233198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.233485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.233767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.234993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.236452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.238220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 45/84] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.238995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.259565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.260491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.260773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.261055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.262288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.263743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.265542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 40/85] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.266146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.321396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.329676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.338119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fd56-750d-4bdd-ba79-4fe61add6c32 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.372916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4b89-7b2c-4417-95ea-4dc6ac0edc8d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.377184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.377836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.378237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.378521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.412271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.413180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.413477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.413758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.449010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.450475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.482689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.484261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.536861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.538612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.547711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 46/86] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:56.548533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.581824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 41/87] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:56.582705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.646221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173372a-6054-4068-b0c8-6513146e1a99 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.680520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.681305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.681587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.681859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.683062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.683188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444e070-8066-42b7-aa25-60b53a9a2a77 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.684525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.686159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 47/88] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.686941 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.718566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.719153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.719445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.719728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.720568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=42d160b5b22a4fd0afc9965b94569b2d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:56.720887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.722388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.727742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 42/89] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/role_assignments?user.id=42d160b5b22a4fd0afc9965b94569b2d&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.728525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.749458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.753618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.796220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85291469-0ffa-4058-85ff-28f6bbf209ee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.834417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.835118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.835366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.835641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.848799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6bed7-6012-4125-ae61-441fde4e2a5b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:56.892443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:56.892443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:56.892443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:56.892443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:56.892830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.893919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.895703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 43/90] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:56.896553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:56.914629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:56.916120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:56.984891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:56.988509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:57.000388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f921-a9ca-4167-9449-69fb1aa0f264 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:57.031092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 48/91] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:57.036136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:57.036594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:57.037730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:57.038037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:57.038322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:57.039515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:57.040971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:57.047271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 44/92] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:07:56 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:57.047271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:57.154946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36342d4-03a2-4445-987e-1ab9e331ba0a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:57.158568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de480-4a60-44ae-82b0-bd54a4d6faf1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:57.195027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:57.195805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:57.196096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:57.196380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:57.196918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:57.197154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:57.198458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:57.198754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:57.199033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:57.199251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:57.199874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=59ecf7a36c4a499aaba37cd54ff4117a) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:57.200190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:57.201625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:57.218279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 45/93] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:57 2022] GET /identity/v3/role_assignments?user.id=59ecf7a36c4a499aaba37cd54ff4117a&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:57.218279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:57.238705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:57.284458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 49/94] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:07:57 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:57.285195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:57.314398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:57.330375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95db5-523d-4b34-a613-4b81cfa2bb65 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:57.369215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:57.370812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:57.371102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:57.371377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] PATH_INFO: `/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:57.372685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] RBAC: Authorizing `identity:get_project(project_id=c3f9c81d56dd4b17ae29e6b668e2dd05)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:57.374273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:57.376233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 46/95] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:07:57 2022] GET /identity/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:57.382198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:57.409015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625100-6c4e-4946-9b89-02bf36c8aa61 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:57.450664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:57.451374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:57.451664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:57.452043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:57.453013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] RBAC: Adding query filter params (role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=42d160b5b22a4fd0afc9965b94569b2d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:57.453344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:57.455011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01b6ac-fd1d-4aab-92b5-79e494a32647 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:57.462208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 50/96] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:57 2022] GET /identity/v3/role_assignments?user.id=42d160b5b22a4fd0afc9965b94569b2d&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:57.486325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:57.501338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf8400-2514-41f6-a3da-5015952f2701 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:57.539044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:57.540032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:57.540507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:57.540956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:57.542032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=c3f9c81d56dd4b17ae29e6b668e2dd05, user.id=42d160b5b22a4fd0afc9965b94569b2d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:57.542520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:57.544257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923b0a0-deee-44aa-922b-e53b344fbdb8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:57.558188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 47/97] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:57 2022] GET /identity/v3/role_assignments?user.id=42d160b5b22a4fd0afc9965b94569b2d&scope.project.id=c3f9c81d56dd4b17ae29e6b668e2dd05&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:58.956040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852c68-ce7e-4ca1-b4d4-21f1f20ebe8b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:58.956579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852c68-ce7e-4ca1-b4d4-21f1f20ebe8b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:58.956682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852c68-ce7e-4ca1-b4d4-21f1f20ebe8b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:58.958403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 51/98] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:58.964923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:58.965857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:58.966382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:58.991019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:58.992551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:59.071714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 48/99] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:59.105507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852c68-ce7e-4ca1-b4d4-21f1f20ebe8b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:59.218451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:59.243186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852c68-ce7e-4ca1-b4d4-21f1f20ebe8b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:59.281516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:59.282381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:59.283132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:59.283811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:59.296031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:59.307909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:59.308763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:07:59.309976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 52/100] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:59.316698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:59.432268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:59.456606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48595700-402e-47e0-b4ac-32ae3c69a926 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:59.501579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:59.502664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:59.503191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:59.503657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:59.504595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:59.505113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:59.506755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:59.516228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 49/101] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:07:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:59.522101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:59.655896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258f4fc-06a9-48f7-80dc-8f3c9ce59f04 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:59.693402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:59.694369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:59.694665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:59.694955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:59.696173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:59.698221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:59.700195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 53/102] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:07:59 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:59.705762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:59.850144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99f03-381f-460a-b109-ce1b87a57c22 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:59.893170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31628dc-f10b-4a97-9a9c-be805f36fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:59.900277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31628dc-f10b-4a97-9a9c-be805f36fe27 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:59.900277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31628dc-f10b-4a97-9a9c-be805f36fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:59.900277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31628dc-f10b-4a97-9a9c-be805f36fe27 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:59.900277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31628dc-f10b-4a97-9a9c-be805f36fe27 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:59.900277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31628dc-f10b-4a97-9a9c-be805f36fe27 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:59.901937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 50/103] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:07:59 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:59.907822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:59.920179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:59.961635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e1db-947e-495a-936d-d9ee81024e85 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:59.961971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e1db-947e-495a-936d-d9ee81024e85 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:59.962241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e1db-947e-495a-936d-d9ee81024e85 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:59.963934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 51/104] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:59.969818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45758f3-ac71-4d21-a739-5f0ddc4edb5e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:59.970432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45758f3-ac71-4d21-a739-5f0ddc4edb5e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:59.970432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45758f3-ac71-4d21-a739-5f0ddc4edb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.020941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d45758f3-ac71-4d21-a739-5f0ddc4edb5e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:00.022208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d45758f3-ac71-4d21-a739-5f0ddc4edb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:00.028352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:00.118023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0f28-50b5-4b10-a2ed-f6c7cebbe440 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:00.154542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 52/105] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:00.181449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4f25-1bfc-4212-bf46-99c32f60d0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:00.182924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4f25-1bfc-4212-bf46-99c32f60d0d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.183214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4f25-1bfc-4212-bf46-99c32f60d0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.183496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4f25-1bfc-4212-bf46-99c32f60d0d4 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/42d160b5b22a4fd0afc9965b94569b2d/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.185526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844abd9-5d32-4571-9026-fc7c91597578 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.185807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f4f25-1bfc-4212-bf46-99c32f60d0d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e4753a6444d1b6c9f4ab90239a4e, user_id=42d160b5b22a4fd0afc9965b94569b2d, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:00.185910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844abd9-5d32-4571-9026-fc7c91597578 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.186309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844abd9-5d32-4571-9026-fc7c91597578 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.187304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f4f25-1bfc-4212-bf46-99c32f60d0d4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:00.188056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 53/106] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:00.188776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844abd9-5d32-4571-9026-fc7c91597578 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:00.274281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 54/107] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:07:59 2022] PUT /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/42d160b5b22a4fd0afc9965b94569b2d/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:00.275318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.275670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.275921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.305081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844abd9-5d32-4571-9026-fc7c91597578 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:00.314186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:00.318812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:00.380038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:00.380768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.381314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.381608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.402374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:00.411542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:00.428975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:00.429892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:00.430690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:00.437595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 54/108] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:00.443602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:00.458419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:00.466860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 55/109] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:00.532385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:00.604832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a90e4-7b14-4323-93d8-5a761c287060 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:00.643797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:00.644414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.644710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.645001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.645838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:00.646187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:00.647650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77258f9-5419-4376-a483-9fc5bce9463f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:00.657698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 55/110] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:00.662225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b1c7-194e-4006-a586-b406c83c84b9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.662790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b1c7-194e-4006-a586-b406c83c84b9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.663078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b1c7-194e-4006-a586-b406c83c84b9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.664672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 56/111] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:00.668155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057317d3-2b21-4db0-94d7-f9d5e7693e2d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:00.670990 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b1c7-194e-4006-a586-b406c83c84b9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:00.705106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c8be-6a22-48a6-9859-823f12561a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:00.705942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c8be-6a22-48a6-9859-823f12561a4d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.706261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c8be-6a22-48a6-9859-823f12561a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.706544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c8be-6a22-48a6-9859-823f12561a4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.727527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439c8be-6a22-48a6-9859-823f12561a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b439c8be-6a22-48a6-9859-823f12561a4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:00.736273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:00.738368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 56/112] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:00.740219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.741661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.741661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.751618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:00.780513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:00.781807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:00.796676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b1c7-194e-4006-a586-b406c83c84b9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:00.850134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:00.851215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:00.851581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:00.851924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:00.854685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:00.855835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:00.857393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:00.859199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 57/113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:00 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:00.859984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:00.870251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 57/114] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:00.871180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:00.996837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ed8a7-95bb-4e87-ada5-253f6a5b730f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.054161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e3c7-c626-4c50-94aa-6b6975bb789e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.067437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.068660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.069138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.069627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.072225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.074023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.076729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 58/115] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:00 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:01.079539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.122246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:01.129408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.131038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.131487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.134374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.134374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:01.134374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.136342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.147025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 58/116] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:01.148246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.166885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:01.215171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e556-812a-46b3-98f3-55ba53d9ae5a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.257694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0bc13-6382-46a3-aa5a-bd11b23ee6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.258847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0bc13-6382-46a3-aa5a-bd11b23ee6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.259402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0bc13-6382-46a3-aa5a-bd11b23ee6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.259686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0bc13-6382-46a3-aa5a-bd11b23ee6b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.260995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658b29b-d3fa-4bb2-8a13-752101e68518 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.271446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0bc13-6382-46a3-aa5a-bd11b23ee6b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-eed0bc13-6382-46a3-aa5a-bd11b23ee6b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:01.279321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:01.280170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:01.280919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 59/117] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:01.282169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008885df-c0ff-4496-adc9-0b46f5c0c32f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.282169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008885df-c0ff-4496-adc9-0b46f5c0c32f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.282458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008885df-c0ff-4496-adc9-0b46f5c0c32f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.288554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 60/118] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:01.288554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008885df-c0ff-4496-adc9-0b46f5c0c32f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.303754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeaaa8-1724-40c6-9f44-442946bb685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.304660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeaaa8-1724-40c6-9f44-442946bb685e None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.304953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeaaa8-1724-40c6-9f44-442946bb685e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.305237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeaaa8-1724-40c6-9f44-442946bb685e None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/59ecf7a36c4a499aaba37cd54ff4117a/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.307872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deeaaa8-1724-40c6-9f44-442946bb685e None admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e4753a6444d1b6c9f4ab90239a4e, user_id=59ecf7a36c4a499aaba37cd54ff4117a, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.309331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deeaaa8-1724-40c6-9f44-442946bb685e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.390237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008885df-c0ff-4496-adc9-0b46f5c0c32f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.406462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:01.420256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 59/119] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:01 2022] PUT /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/59ecf7a36c4a499aaba37cd54ff4117a/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:01.421860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011baf5-1db3-4fc9-b12d-91950c27ba02 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.422265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011baf5-1db3-4fc9-b12d-91950c27ba02 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.422619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011baf5-1db3-4fc9-b12d-91950c27ba02 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.424098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 60/120] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:01.424737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4648506-a4a8-45e5-8269-c60e3a700753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.427001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648506-a4a8-45e5-8269-c60e3a700753 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.427001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648506-a4a8-45e5-8269-c60e3a700753 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.427001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648506-a4a8-45e5-8269-c60e3a700753 None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.429178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011baf5-1db3-4fc9-b12d-91950c27ba02 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.431001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648506-a4a8-45e5-8269-c60e3a700753 None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.433049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648506-a4a8-45e5-8269-c60e3a700753 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.434920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 61/121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:01.436481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3610e8b-3936-4685-9d2a-e8b3fcc4b4f3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.436615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3610e8b-3936-4685-9d2a-e8b3fcc4b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.436843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3610e8b-3936-4685-9d2a-e8b3fcc4b4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.457068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c3610e8b-3936-4685-9d2a-e8b3fcc4b4f3 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:01.458417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c3610e8b-3936-4685-9d2a-e8b3fcc4b4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:01.500555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:01.549539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 62/122] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:01.557298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.557641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.557940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.563324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011baf5-1db3-4fc9-b12d-91950c27ba02 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.589210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:01.590555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:01.603183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.604434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.604724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.605009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.605888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:01.607059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.608087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.617988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 61/123] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:01.618843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.674018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 63/124] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:01.674018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.784352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:01.784456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55f942-06d7-438e-8fa6-1db5b56f6e07 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.784456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:01.787340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.788650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.789050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.789434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.790862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.792630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.794630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 62/125] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:01.799910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.809003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534790c3-fc13-4ebf-b72d-0ba0499b75ee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.859057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.860531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.861248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.861685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.876392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:01.888781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:01.890026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:01.891035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:01.894288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 64/126] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:01.900410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:01.916257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c79e-b19e-4fb5-8d64-02b180249054 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:01.954994 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:01.956055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:01.956450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:01.956838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:01.958223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:01.960097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:01.962136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 63/127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:01.963044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.030352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:02.030839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c415d3-9372-4f0d-ab14-d0532fb132b1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.035075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:02.080572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.081873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.082440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.093407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.093407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.093407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.093656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256d6a7-618b-4954-94ff-e3963e837ddf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.094085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 65/128] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:02.094085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.137752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.138699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.138996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.139288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/42d160b5b22a4fd0afc9965b94569b2d/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.141540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e4753a6444d1b6c9f4ab90239a4e, user_id=42d160b5b22a4fd0afc9965b94569b2d, role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.143151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.216775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48ebb3-69e1-4fed-9207-db5779431171 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.228103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 64/129] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:01 2022] PUT /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/42d160b5b22a4fd0afc9965b94569b2d/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:02.229973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.258138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.258955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.259296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.259583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.261041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:02.261421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.263407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.281233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 66/130] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:02.282118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.348221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:02.361669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fae82-804a-4cff-8c9a-e91fb75e1fe0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.375748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:02.411951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.413121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.413411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.414261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] PATH_INFO: `/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.417111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] RBAC: Authorizing `identity:get_project(project_id=c3f9c81d56dd4b17ae29e6b668e2dd05)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.418912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.427088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 65/131] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:02 2022] GET /identity/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:02.427566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.502688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2936-b846-4cf9-8810-523558c729b9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.542840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.544364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.544364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.544644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.545296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.547091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.586755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a44a5a-c65d-4cde-8653-73f1c0422df7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.624069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.625364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.625856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.626373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] PATH_INFO: `/v3/users/f9fd9aa988d449d696b6956500a1a965` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.648738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 67/132] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:08:02 2022] POST /identity/v3/projects => generated 302 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:02.654531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.658927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] RBAC: Authorizing `identity:get_user(user_id=f9fd9aa988d449d696b6956500a1a965)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.660488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.662449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 66/133] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:02 2022] GET /identity/v3/users/f9fd9aa988d449d696b6956500a1a965 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:02.668644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:02.764415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:02.773592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:02.788286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea618f-20c0-49d2-b7ce-cd3c1456d388 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.855176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bbf1-ac81-4c03-83c8-818c78f14fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.856102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bbf1-ac81-4c03-83c8-818c78f14fd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.856390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bbf1-ac81-4c03-83c8-818c78f14fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.856672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bbf1-ac81-4c03-83c8-818c78f14fd1 None admin] PATH_INFO: `/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05/users/42d160b5b22a4fd0afc9965b94569b2d/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.860128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207bbf1-ac81-4c03-83c8-818c78f14fd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3f9c81d56dd4b17ae29e6b668e2dd05, user_id=42d160b5b22a4fd0afc9965b94569b2d, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:02.861390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207bbf1-ac81-4c03-83c8-818c78f14fd1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:02.909756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8796-575d-4fda-9297-d6bbb2858dca None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:02.940350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 68/134] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:02 2022] PUT /identity/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05/users/42d160b5b22a4fd0afc9965b94569b2d/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:02.941696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460ef7-6947-424f-bb3a-f8dbfa79ccba None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.943902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460ef7-6947-424f-bb3a-f8dbfa79ccba None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.943902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460ef7-6947-424f-bb3a-f8dbfa79ccba None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.943902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 69/135] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:02.952308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.952602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.952889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.978730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:02.980301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:02.981649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:02.982753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:02.988979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:02.991968 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:03.094157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:03.095377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:03.114010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 70/136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:03.156977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:03.163059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:03.282525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:03.289628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 67/137] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:03.315670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:03.328256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefdfcd-4828-4ab3-a41d-1c85b04019a2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:03.383955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:03.385438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.385734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.386074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.411434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:03.422095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:03.422958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:03.423713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 71/138] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:03.428577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:03.469739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28f68-1e8d-4c15-8889-7489b225d319 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:03.524649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:03.526242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.526535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.526927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.529942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:03.531452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:03.533189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 68/139] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:03 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:03.540291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:03.547306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:03.577371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d25271-5aa2-4744-995a-b748de902eca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:03.612942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:03.613969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.614516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.614994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.615951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:03.616468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:03.618117 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:03.627807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 72/140] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:03.630373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:03.638730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:03.761531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04265c-2e30-4e47-b665-01729494ac89 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:03.825632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:03.826323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.826608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.826886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.827805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] RBAC: Adding query filter params (role.id=af08a486fc834d47979805f78c4d9703, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=f9fd9aa988d449d696b6956500a1a965) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:03.828115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:03.829606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72373867-937e-4d9e-b27d-d0d7a07caf50 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:03.837649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 69/141] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:03 2022] GET /identity/v3/role_assignments?user.id=f9fd9aa988d449d696b6956500a1a965&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=af08a486fc834d47979805f78c4d9703 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:03.840997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bbb5-24cb-47b7-87e7-89c6a4d81f0e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.841291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bbb5-24cb-47b7-87e7-89c6a4d81f0e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.841572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bbb5-24cb-47b7-87e7-89c6a4d81f0e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.842983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 70/142] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:03.846060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2c2b3-ff7b-4a91-9b19-8e2a80f56b26 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:03.849079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.849367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.849649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.874657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:03.875868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:03.954868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:03.955790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:03.956082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:03.956375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:03.957726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:03.959256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:03.960963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 73/143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:03 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:03.970311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:03.973957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:03.982542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 71/144] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:04.019273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:04.116044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:04.130306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddcc2-7e0f-49a4-b193-3ece393d194f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:04.174719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:04.175381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:04.175668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:04.175943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:04.286940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:04.288618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:04.304783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d55ac-50ca-49ee-8866-c6492d6c1f92 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:04.386469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:04.406730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:04.407654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:04.407823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:04.408093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:04.414714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 74/145] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:04.424712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:04.438906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:04.446569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:04.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:04.448290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 72/146] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:04.455073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:04.588647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:04.636989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594a45-0496-4949-b09c-b020211b0ce4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:04.708666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f5e4-4534-4dcd-be2c-97462506b8ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:04.740831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:04.742363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:04.742902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:04.743424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:04.747001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:04.748848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:04.750992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 75/147] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:04 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:04.756906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:04.803815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:04.804673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:04.804968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:04.805372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:04.806179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:04.806493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:04.808151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:04.834332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:04.840557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 73/148] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:04.846528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:04.907994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c8e10-0f72-467d-822d-844e0317af35 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:04.945967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:04.947145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:04.948279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:04.948759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:04.949805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=42d160b5b22a4fd0afc9965b94569b2d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:04.950363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:04.952067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:04.958831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 76/149] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:04 2022] GET /identity/v3/role_assignments?user.id=42d160b5b22a4fd0afc9965b94569b2d&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:05.065851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21b534-bbb0-46b2-82ea-bb0ec40aed31 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:05.093957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:05.130969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e978e56-c630-434f-acf8-aa176b770445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:05.132268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e978e56-c630-434f-acf8-aa176b770445 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.132761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e978e56-c630-434f-acf8-aa176b770445 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.133249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e978e56-c630-434f-acf8-aa176b770445 None admin] PATH_INFO: `/v3/users/59ecf7a36c4a499aaba37cd54ff4117a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.138790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e978e56-c630-434f-acf8-aa176b770445 None admin] RBAC: Authorizing `identity:get_user(user_id=59ecf7a36c4a499aaba37cd54ff4117a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:05.140662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e978e56-c630-434f-acf8-aa176b770445 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:05.142731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 74/150] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:04 2022] GET /identity/v3/users/59ecf7a36c4a499aaba37cd54ff4117a => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:05.148466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:05.257448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:05.262875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d184-73b5-4f50-803b-c4c44bd7fe12 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:05.298759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:05.300201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.300688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.301177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.376927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:05.379644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:05.478436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc77c5-b8c6-45d6-bbbe-f57a996697eb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.479986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc77c5-b8c6-45d6-bbbe-f57a996697eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.480463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc77c5-b8c6-45d6-bbbe-f57a996697eb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.482061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 75/151] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:05.487039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.487598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.488142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.515306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:05.518420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:05.520688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:05.527401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 77/152] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:05.534734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:05.649795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19e0c0-d50c-4477-bd50-4a0dd263b9c4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:05.688850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:05.690089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.690596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.691166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.691387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 76/153] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:05.692835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:05.694572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:05.696564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 78/154] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:05 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:05.702328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:05.725593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:05.824432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:05.832593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0047c-c9cf-42c3-8dc7-9b49ff8ad85a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:05.852578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:05.870868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286abca-05d3-4b56-9233-5f00cca8edd5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:05.872415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:05.873084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.873374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.873656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.874532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=59ecf7a36c4a499aaba37cd54ff4117a) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:05.874851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:05.876412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838a40b-203d-4d72-8a6d-240d16793f4e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:05.882559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 77/155] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:05 2022] GET /identity/v3/role_assignments?user.id=59ecf7a36c4a499aaba37cd54ff4117a&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:05.883818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d9d3-d8ea-4a65-b45a-186f707f80d6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.884120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d9d3-d8ea-4a65-b45a-186f707f80d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.884840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d9d3-d8ea-4a65-b45a-186f707f80d6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.887197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 78/156] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:05.887197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1323-7682-4588-aa87-d948c629d828 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.887528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1323-7682-4588-aa87-d948c629d828 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.887764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1323-7682-4588-aa87-d948c629d828 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.889065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 79/157] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:05.894778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.895072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.900043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.914515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:05.914926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930315e-e0b3-407e-934f-7100e2377d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:05.915763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930315e-e0b3-407e-934f-7100e2377d7b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.915958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:05.916699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930315e-e0b3-407e-934f-7100e2377d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.916943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930315e-e0b3-407e-934f-7100e2377d7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.930270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930315e-e0b3-407e-934f-7100e2377d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4930315e-e0b3-407e-934f-7100e2377d7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:05.939521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:05.940452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:05.941294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 79/158] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:05.944860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:05.945156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:05.945823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:05.969639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:05.970908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:06.017412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 80/159] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:06.018356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.073672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 80/160] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:06.074626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.151208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.160822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174179f-99fc-4c4c-b568-b137344e2569 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.176602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.201614 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.202328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.202615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.202894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.203658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:06.203970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.205372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.206315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08ee8-2bbe-4afd-9cf4-ec6390afc477 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.218047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 81/161] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:06.218047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.249311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.250135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.250420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.250692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.251864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.253451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.255277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 81/162] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:06.255885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.326213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2272e8-b14e-4d6b-ac8b-40b16fcd9536 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.361508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.362350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.362641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.362919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.363139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257cc62-ee13-45c7-a1a8-4356254c77c8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.374763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:06.382470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:06.383342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:06.384232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 82/163] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:06.384927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.393774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.408578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.408578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.408578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.408578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.408904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.410371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.412019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 82/164] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:06.412019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.424973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.503854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043a93-9cc1-42ce-b5b2-f7f78a9c01cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.541212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.541885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.542219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.542499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481479b0-dcaf-44d5-91ef-7ab24340c7b5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.542599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.543218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.544681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.577090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.577776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.578070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.578351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.579101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:06.579409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.580808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.589501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 83/165] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:06.590326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.644210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.671969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 83/166] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:06 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:06.671969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.708907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cfd37-d393-4701-902a-f9aaa1773cfe None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.751513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30855f3-b172-4a18-aeed-fa06352bb0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.752451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30855f3-b172-4a18-aeed-fa06352bb0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.752924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30855f3-b172-4a18-aeed-fa06352bb0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.753378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30855f3-b172-4a18-aeed-fa06352bb0b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.778568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.788855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97615-3d57-4a20-91ed-d6cf89aa06ce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.827427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e341024-764d-470c-98ea-802f2381b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:06.828317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e341024-764d-470c-98ea-802f2381b306 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.828601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e341024-764d-470c-98ea-802f2381b306 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.828882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e341024-764d-470c-98ea-802f2381b306 None admin] PATH_INFO: `/v3/users/42d160b5b22a4fd0afc9965b94569b2d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.830966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e341024-764d-470c-98ea-802f2381b306 None admin] RBAC: Authorizing `identity:get_user(user_id=42d160b5b22a4fd0afc9965b94569b2d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.831612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e341024-764d-470c-98ea-802f2381b306 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.833566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 84/167] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/users/42d160b5b22a4fd0afc9965b94569b2d => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:06.834827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc8d8-455a-4c76-9a81-1d21ac39d9ca None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.835123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc8d8-455a-4c76-9a81-1d21ac39d9ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.835403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc8d8-455a-4c76-9a81-1d21ac39d9ca None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.836782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 85/168] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:06.837767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30855f3-b172-4a18-aeed-fa06352bb0b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:06.839073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc8d8-455a-4c76-9a81-1d21ac39d9ca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:06.839626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30855f3-b172-4a18-aeed-fa06352bb0b7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:06.906024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.962487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 84/169] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:06.964742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07543-c469-466d-8eee-9211bc40250e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:06.965018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07543-c469-466d-8eee-9211bc40250e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:06.965304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07543-c469-466d-8eee-9211bc40250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:06.971458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc8d8-455a-4c76-9a81-1d21ac39d9ca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:06.983902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8df07543-c469-466d-8eee-9211bc40250e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:06.985159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8df07543-c469-466d-8eee-9211bc40250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:07.016345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:07.017174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:07.017466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:07.017747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:07.054169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:07.067416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 85/170] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:07.071403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07543-c469-466d-8eee-9211bc40250e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.113001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:07.113735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:07.169967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:07.191262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07543-c469-466d-8eee-9211bc40250e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:07.229308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:07.230654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:07.231019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:07.231372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:07.233164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:07.235540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:07.238224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 86/171] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:07.243210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.246615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 86/172] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:07.248591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.329033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:07.373824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22afd-ab80-4043-810f-0a4a9bccf604 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:07.388923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177107-7959-4bdd-b147-20a9cbd76255 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:07.411464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:07.412300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:07.412854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:07.413134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:07.424056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:07.432523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:07.433499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:07.434342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 87/173] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:07.434983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.436443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:07.437530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:07.438874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:07.439394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:07.440589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] RBAC: Adding query filter params (role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=42d160b5b22a4fd0afc9965b94569b2d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:07.441114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:07.442835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:07.450457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 87/174] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/role_assignments?user.id=42d160b5b22a4fd0afc9965b94569b2d&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:07.451505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.462397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:07.621167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da377b8-cabc-4fc8-b4b1-4b46d4f11d9e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:07.674751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a17a-19e8-4544-9c5a-40db521a3d76 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:07.680544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:07.681422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:07.682276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:07.682556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] PATH_INFO: `/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:07.684650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] RBAC: Authorizing `identity:get_project(project_id=c3f9c81d56dd4b17ae29e6b668e2dd05)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:07.686209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:07.688193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 88/175] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/projects/c3f9c81d56dd4b17ae29e6b668e2dd05 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:07.698029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.743656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:07.807263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:07.808336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:07.808822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:07.809296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:07.810305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:07.810814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:07.818017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:07.841864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 88/176] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:07.847753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:07.982368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:08.045101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4065d5-7a2a-400c-ad5c-79692c0629fa None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:08.084020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec51895-12b2-42b9-aee8-16e216b8c437 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:08.130070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:08.130070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:08.130070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:08.130070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] PATH_INFO: `/v3/users/f9fd9aa988d449d696b6956500a1a965` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:08.131116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] RBAC: Authorizing `identity:get_user(user_id=f9fd9aa988d449d696b6956500a1a965)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:08.139917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:08.142456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 89/177] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/users/f9fd9aa988d449d696b6956500a1a965 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:08.149386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:08.153650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:08.155144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:08.155424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:08.155698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:08.156534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=c3f9c81d56dd4b17ae29e6b668e2dd05, user.id=42d160b5b22a4fd0afc9965b94569b2d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:08.157658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:08.160107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:08.169531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 89/178] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:07 2022] GET /identity/v3/role_assignments?user.id=42d160b5b22a4fd0afc9965b94569b2d&scope.project.id=c3f9c81d56dd4b17ae29e6b668e2dd05&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 608 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:08.249464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:08.350487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52f35f-3c01-4f9b-af64-efac076af824 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:08.410856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af22c-c913-4d64-8a4f-985ed32f0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:08.411738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af22c-c913-4d64-8a4f-985ed32f0538 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:08.412023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af22c-c913-4d64-8a4f-985ed32f0538 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:08.412305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af22c-c913-4d64-8a4f-985ed32f0538 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:08.415893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af22c-c913-4d64-8a4f-985ed32f0538 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:08.417520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af22c-c913-4d64-8a4f-985ed32f0538 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:08.419664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 90/179] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:08 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:08.429564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:08.576527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac2832-1c6a-4d46-9ae3-2610fe28e838 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:08.615000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319f218-d417-4189-b76f-09af3b77bd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:08.615903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319f218-d417-4189-b76f-09af3b77bd98 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:08.616196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319f218-d417-4189-b76f-09af3b77bd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:08.616479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319f218-d417-4189-b76f-09af3b77bd98 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/f9fd9aa988d449d696b6956500a1a965/roles/af08a486fc834d47979805f78c4d9703` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:08.618536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319f218-d417-4189-b76f-09af3b77bd98 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e4753a6444d1b6c9f4ab90239a4e, user_id=f9fd9aa988d449d696b6956500a1a965, role_id=af08a486fc834d47979805f78c4d9703)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:08.620554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319f218-d417-4189-b76f-09af3b77bd98 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:08.711180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 90/180] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:08 2022] PUT /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/users/f9fd9aa988d449d696b6956500a1a965/roles/af08a486fc834d47979805f78c4d9703 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:09.303034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028219e-441d-48bd-bcd3-ba52657a9755 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.303541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028219e-441d-48bd-bcd3-ba52657a9755 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.303616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028219e-441d-48bd-bcd3-ba52657a9755 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.305207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 91/181] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:09.310640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca34b5-e14b-46ae-b3a3-79a4a59a88ed None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.310927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca34b5-e14b-46ae-b3a3-79a4a59a88ed None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.311203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca34b5-e14b-46ae-b3a3-79a4a59a88ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.317202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:09.328624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-55ca34b5-e14b-46ae-b3a3-79a4a59a88ed None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:09.329808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-55ca34b5-e14b-46ae-b3a3-79a4a59a88ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:09.398354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 91/182] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:09.422525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028219e-441d-48bd-bcd3-ba52657a9755 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:09.495213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823697df-26ef-499a-b5b0-d5eff7e9b7bb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.496174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823697df-26ef-499a-b5b0-d5eff7e9b7bb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.496652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823697df-26ef-499a-b5b0-d5eff7e9b7bb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.498297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 92/183] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:09.503604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3e56b-2d0c-4783-85ea-9d032b831c88 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.504191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3e56b-2d0c-4783-85ea-9d032b831c88 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.504630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3e56b-2d0c-4783-85ea-9d032b831c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.524708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-07a3e56b-2d0c-4783-85ea-9d032b831c88 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:09.527187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-07a3e56b-2d0c-4783-85ea-9d032b831c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:09.535350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028219e-441d-48bd-bcd3-ba52657a9755 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:09.559803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:09.579905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:09.581114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.581551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.581981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.598847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:09.606733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 93/184] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:09.608034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba2b7d-4aea-42e4-94fb-b320e68f0418 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.608328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba2b7d-4aea-42e4-94fb-b320e68f0418 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.608714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba2b7d-4aea-42e4-94fb-b320e68f0418 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.611116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 94/185] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:09.617049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.617333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.617613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:09.619862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:09.620719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:09.621549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:09.626038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 92/186] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:09.628705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:09.644704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:09.645904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:09.707075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:09.715619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 95/187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:09.716340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:09.742789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f0906-c3c2-4b82-b2ea-4d2dbb811e79 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:09.779394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:09.780065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.780351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.780641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.781426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:09.781712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:09.783171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:09.792207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 93/188] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:09.792207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:09.827082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6d158-ae51-45b2-a223-727cc7d48d40 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:09.842251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:09.863753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:09.864586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.864874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.865156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.877421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:09.885954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:09.887205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:09.887994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:09.890032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 96/189] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:09.890032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:09.910732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6a31-0da0-43c5-aa31-a451c421e933 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:09.951310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:09.952513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:09.952806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:09.953090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:09.954314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:09.955789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:09.957644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 94/190] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:09.958216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:09.965905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.016768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f0734-b85e-4f21-abec-6d9cb151c28d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.056810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.057676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.057961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.058268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] PATH_INFO: `/v3/users/daf3e9e8572442d5878541452cdf7a22` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.064520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bf0aa-c5da-49b5-a959-1cab57be67b1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.071471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] RBAC: Authorizing `identity:get_user(user_id=daf3e9e8572442d5878541452cdf7a22)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.073497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.079503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 97/191] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:09 2022] GET /identity/v3/users/daf3e9e8572442d5878541452cdf7a22 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:10.079503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:10.080663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.110625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.113654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.113654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.113654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.113654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:10.113654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.114603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.123657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 95/192] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:10.124375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:10.193032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab074e97-854d-464b-b709-03379b4a8c3d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.207167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.227383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992669-a02c-4a4f-9f21-f55032cae18f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.229102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.229768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.230136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.230462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.231279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.232727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.257608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.258288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.258572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.258845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.299179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.325796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.327304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.354555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 98/193] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:10 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:10.367030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:10.448095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 96/194] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:10.454068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:10.530481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9790-4330-4fc5-9585-4552fcdbbb22 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.560111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.570032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.570982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.571262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.575319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] PATH_INFO: `/v3/users/daf3e9e8572442d5878541452cdf7a22` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.575319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] RBAC: Authorizing `identity:get_user(user_id=daf3e9e8572442d5878541452cdf7a22)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.575319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.576959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 99/195] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:10 2022] GET /identity/v3/users/daf3e9e8572442d5878541452cdf7a22 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:10.582931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:10.594259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76ffb-f828-408a-842d-1a44de3273a7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.620382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.637792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.639013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.639504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.639852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.641805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.644117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.645860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 97/196] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:10 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:10.652255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:10.702018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e7ac-0525-42e6-b21d-3b4e4c51c0bf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.751525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.752791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.753271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.753884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.777257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337000f8-a41d-46e5-931a-8bb81709d9af None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:10.825005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:10.825695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.825987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.826332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.827438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=daf3e9e8572442d5878541452cdf7a22) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:10.827746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.829898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14a804-b10c-47e6-8f14-03e9ae684297 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.842095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 98/197] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:10 2022] GET /identity/v3/role_assignments?user.id=daf3e9e8572442d5878541452cdf7a22&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:10.845164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607651-3f7c-4b68-b189-82f551b4f8a6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.845462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607651-3f7c-4b68-b189-82f551b4f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.845766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607651-3f7c-4b68-b189-82f551b4f8a6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.846847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:10.847223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 99/198] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:10.848880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:10.852856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:10.853152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:10.853429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:10.867755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:10.875698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:10.877533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:10.910953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:11.024023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 100/199] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:11.042376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 100/200] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:11.048281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:11.052040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:11.191453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b150d52-fff8-4fb4-a6bb-0e6a3012184a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:11.228363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:11.229796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:11.230098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:11.230375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:11.231610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:11.233071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:11.236090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 101/201] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:11 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:11.242937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:11.245937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:11.260865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8673b-3b8b-4905-bbbc-e3b43eccb962 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:11.296485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:11.297286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:11.297566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:11.297840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:11.303499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:11.312226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:11.319960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:11.321721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:11.322571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 101/202] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:11.331533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:11.446823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffbbd9-c067-487e-a562-1fa215bba298 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:11.501706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f4ca-ed7f-4de5-9e6b-81f1abfc5256 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:11.507064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:11.507725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:11.508006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:11.508281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:11.509118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] RBAC: Adding query filter params (role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=daf3e9e8572442d5878541452cdf7a22) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:11.509430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:11.511448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:11.530078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 102/203] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:11 2022] GET /identity/v3/role_assignments?user.id=daf3e9e8572442d5878541452cdf7a22&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:11.579052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:11.579721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:11.580010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:11.580289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:11.581043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:11.581349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:11.586955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:11.596547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 102/204] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:11.602463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:11.719563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:11.759070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e285-aa7e-4749-af08-95a13b783073 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:11.801365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:11.802273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:11.802558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:11.802836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] PATH_INFO: `/v3/users/f9fd9aa988d449d696b6956500a1a965` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:11.804043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] RBAC: Authorizing `identity:get_user(user_id=f9fd9aa988d449d696b6956500a1a965)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:11.805491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:11.807778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 103/205] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:11 2022] GET /identity/v3/users/f9fd9aa988d449d696b6956500a1a965 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:11.813401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:11.893072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:11.952410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8964f-9bca-4d80-a4c3-73bd3553908d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:12.013529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:12.014136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:12.014425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:12.014703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:12.107372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:12.108855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:12.183682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:12.243439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 103/206] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:12.248804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:12.391077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade5a6-a6ec-416c-af94-450f14ca3254 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:12.433478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d850b-c2b8-4f09-9b6b-2980fce254a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:12.434373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d850b-c2b8-4f09-9b6b-2980fce254a3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:12.434653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d850b-c2b8-4f09-9b6b-2980fce254a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:12.434934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d850b-c2b8-4f09-9b6b-2980fce254a3 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:12.436131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d850b-c2b8-4f09-9b6b-2980fce254a3 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:12.437604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d850b-c2b8-4f09-9b6b-2980fce254a3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:12.439515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 104/207] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:12 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:12.445312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:12.603242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce468-1eeb-4458-8aef-ebfcafa11551 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:12.638948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:12.639610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:12.639897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:12.640179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:12.641023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] RBAC: Adding query filter params (role.id=af08a486fc834d47979805f78c4d9703, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e, user.id=f9fd9aa988d449d696b6956500a1a965) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:12.641391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:12.642828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6be6a-85d3-43f1-9c1b-bf9978e445ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:12.654134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 104/208] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:12 2022] GET /identity/v3/role_assignments?user.id=f9fd9aa988d449d696b6956500a1a965&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=af08a486fc834d47979805f78c4d9703 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:12.875409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a9e94-fcb6-48b4-a44b-d01a594e55f6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:12.875932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a9e94-fcb6-48b4-a44b-d01a594e55f6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:12.876010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a9e94-fcb6-48b4-a44b-d01a594e55f6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:12.877461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 105/209] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:12.882718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d3f69-d215-4704-960c-221639c955c4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:12.883239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d3f69-d215-4704-960c-221639c955c4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:12.883743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d3f69-d215-4704-960c-221639c955c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:12.903435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-338d3f69-d215-4704-960c-221639c955c4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:12.903435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-338d3f69-d215-4704-960c-221639c955c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:12.922581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:12.980956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 105/210] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:13.005589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a9e94-fcb6-48b4-a44b-d01a594e55f6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.008797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.128959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a9e94-fcb6-48b4-a44b-d01a594e55f6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:13.143749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315800bf-ab0b-4b56-90ac-6459b88b4a7b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.144041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315800bf-ab0b-4b56-90ac-6459b88b4a7b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.144489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315800bf-ab0b-4b56-90ac-6459b88b4a7b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.145882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 106/211] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:13.152922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.153694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.154332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.169303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:13.170145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.170701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.171150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.172468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:13.174085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:13.175896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 106/212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:13.181129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.184781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:13.187018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:13.271429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.276574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 107/213] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:13.299567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.309871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0404-bde0-4d06-a716-a231665a639f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:13.358994 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710365b-4a4e-4b45-88a8-dcce6daac9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:13.360588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710365b-4a4e-4b45-88a8-dcce6daac9ce None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.361096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710365b-4a4e-4b45-88a8-dcce6daac9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.361573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710365b-4a4e-4b45-88a8-dcce6daac9ce None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.363124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710365b-4a4e-4b45-88a8-dcce6daac9ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:13.365613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710365b-4a4e-4b45-88a8-dcce6daac9ce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:13.388196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.406355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f6826-bcf6-4bcd-82ad-bb00139258e4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:13.440184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:13.440979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.441266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.441549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.452229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:13.460059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:13.460985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:13.461793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:13.466055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 108/214] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:13.467266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.486064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 107/215] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:13 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:08:13.487780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f05d64-5147-42a1-a825-4f462c01783b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.488182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f05d64-5147-42a1-a825-4f462c01783b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.488538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f05d64-5147-42a1-a825-4f462c01783b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.490029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 108/216] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:13.500900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.501732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.502328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.526233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:13.528161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:13.605599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64d3ac-c251-487c-b3aa-ca7c78c52a01 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:13.652213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 109/217] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:13.660162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:13.660784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.661071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.661353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.662160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:13.662478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:13.664141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:13.673290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 109/218] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:13.677523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.678871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.683113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.751970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.799215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665b668-2289-4e2c-9955-20b7d2a40ce9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:13.813400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3485cb-90e6-4f45-9ea6-9965b6c71e64 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:13.844330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:13.845754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.849277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.849277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] PATH_INFO: `/v3/users/594cd03837c049cfb3cf1f9f907b9ddb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.856105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:13.856935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:13.857224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:13.857502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:13.866180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] RBAC: Authorizing `identity:get_user(user_id=594cd03837c049cfb3cf1f9f907b9ddb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:13.867929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:13.870443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:13.870833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 110/219] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/users/594cd03837c049cfb3cf1f9f907b9ddb => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:13.878639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:13.879839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:13.881228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:13.881838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.881908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 110/220] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:13.885903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:13.970126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.014671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118abb9a-4989-4512-9a5a-8e55d3de5abb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.031405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261bdbf-4dac-420a-9411-5a8919b3a6a3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.050630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b09a2-f8ec-4067-a3f0-a6be770d00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.051378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b09a2-f8ec-4067-a3f0-a6be770d00ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.051667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b09a2-f8ec-4067-a3f0-a6be770d00ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.051945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b09a2-f8ec-4067-a3f0-a6be770d00ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.053559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.083291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.083971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.084252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.084525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.085281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:14.085588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.087358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b862b7-b8e6-47b7-884e-b4cfa56ee01b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.096843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 111/221] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:14.102454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca265e27-b3dd-4230-a1ee-1a4ed1777a1e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.102454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca265e27-b3dd-4230-a1ee-1a4ed1777a1e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.102454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca265e27-b3dd-4230-a1ee-1a4ed1777a1e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.102454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 112/222] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:14.105731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca265e27-b3dd-4230-a1ee-1a4ed1777a1e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.149518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b09a2-f8ec-4067-a3f0-a6be770d00ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.151288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b09a2-f8ec-4067-a3f0-a6be770d00ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.219481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.248891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca265e27-b3dd-4230-a1ee-1a4ed1777a1e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.276336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 111/223] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:14.281163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.281780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.282579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.302384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.303225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:14.303335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.303556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.303835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] PATH_INFO: `/v3/users/daf3e9e8572442d5878541452cdf7a22` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.305081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] RBAC: Authorizing `identity:get_user(user_id=daf3e9e8572442d5878541452cdf7a22)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.305585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:14.307157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.313569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 113/224] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/users/daf3e9e8572442d5878541452cdf7a22 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:14.313569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.363323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.381825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 112/225] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:14.383025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.424426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e892c-2403-42aa-888f-36988b3e277c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.462907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.463838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.464132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.464417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.465799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.467331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.469396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 114/226] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:14.470204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.480437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.489534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f694910-aafb-40a9-9be8-8400b745e2a7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.525292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.526504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.526982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.527429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.528890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.530623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.532573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 113/227] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:14.538025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.597312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2cea-a301-4789-9619-35dce8c69142 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.614693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.637531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.638501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.638883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.639170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.651257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:14.651784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9531-b484-4cd1-a79f-30f29b4415ea None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:14.660003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:14.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:14.661682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 115/228] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:14.662364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.691643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.692657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.693157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.693628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.694699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=594cd03837c049cfb3cf1f9f907b9ddb) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:14.695210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.696858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.710135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 114/229] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/role_assignments?user.id=594cd03837c049cfb3cf1f9f907b9ddb&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:14.711623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:14.754545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.777912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ab5e-8efb-40cf-b523-fd738ea13dce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.830185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.832031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.832646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.835842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112/users/daf3e9e8572442d5878541452cdf7a22/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.840598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9060c5c191c541fa8daff8f02e043112, user_id=daf3e9e8572442d5878541452cdf7a22, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.846278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.890299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeeb4e-84e6-4a4c-b79f-68eb29f09ef6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:14.932866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 116/230] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:14 2022] PUT /identity/v3/projects/9060c5c191c541fa8daff8f02e043112/users/daf3e9e8572442d5878541452cdf7a22/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:14.939643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:14.940953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:14.940953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:14.940953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:14.941749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:14.942087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:14.943550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:14.954990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 115/231] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:14.960723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:15.007437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:15.081834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e88027-3fe4-4a48-add7-0d5f83ea97c2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:15.134226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:15.135157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:15.135443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:15.135722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] PATH_INFO: `/v3/users/daf3e9e8572442d5878541452cdf7a22` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:15.136970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=daf3e9e8572442d5878541452cdf7a22)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:15.138603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:15.140536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 117/232] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:14 2022] GET /identity/v3/users/daf3e9e8572442d5878541452cdf7a22 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:15.146053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:15.248861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:15.264902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38709-5904-42b0-a572-a9ca2b8da841 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:15.302610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf39fd-48fa-4f4a-9ec9-84dfb050c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:15.303874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf39fd-48fa-4f4a-9ec9-84dfb050c0df None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:15.304386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf39fd-48fa-4f4a-9ec9-84dfb050c0df None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:15.304866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf39fd-48fa-4f4a-9ec9-84dfb050c0df None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:15.306406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf39fd-48fa-4f4a-9ec9-84dfb050c0df None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:15.308125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf39fd-48fa-4f4a-9ec9-84dfb050c0df None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:15.310427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 116/233] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:15 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:15.318108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:15.475410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c98d4-2be5-46bf-85a1-ce63076d7cf1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:15.477373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:15.512140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24114a8-331b-4da9-8834-356bb25b5c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:15.513056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24114a8-331b-4da9-8834-356bb25b5c39 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:15.513344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24114a8-331b-4da9-8834-356bb25b5c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:15.513625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24114a8-331b-4da9-8834-356bb25b5c39 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112/users/daf3e9e8572442d5878541452cdf7a22/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:15.516141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24114a8-331b-4da9-8834-356bb25b5c39 None admin] RBAC: Authorizing `identity:create_grant(project_id=9060c5c191c541fa8daff8f02e043112, user_id=daf3e9e8572442d5878541452cdf7a22, role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:15.517850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24114a8-331b-4da9-8834-356bb25b5c39 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:15.597172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 118/234] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:15 2022] PUT /identity/v3/projects/9060c5c191c541fa8daff8f02e043112/users/daf3e9e8572442d5878541452cdf7a22/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:15.991412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a35b4-8874-4689-8cbe-4c42f446f641 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:15.991920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a35b4-8874-4689-8cbe-4c42f446f641 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:15.991996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a35b4-8874-4689-8cbe-4c42f446f641 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:15.993643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 117/235] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:15.999843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c0248-17f6-4a9e-84d9-8cbf91834ef1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.000270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c0248-17f6-4a9e-84d9-8cbf91834ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.000465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c0248-17f6-4a9e-84d9-8cbf91834ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.018345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-354c0248-17f6-4a9e-84d9-8cbf91834ef1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:16.019566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-354c0248-17f6-4a9e-84d9-8cbf91834ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:16.099443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 119/236] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:16.112049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5027bc-b61e-47a1-b367-84ebc06fdff6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.112397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5027bc-b61e-47a1-b367-84ebc06fdff6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.112690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5027bc-b61e-47a1-b367-84ebc06fdff6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.114236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 118/237] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:16.120697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.120988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.121270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.137627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:16.138967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:16.145883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5027bc-b61e-47a1-b367-84ebc06fdff6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:16.276927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 120/238] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:16.304596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:16.328822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5027bc-b61e-47a1-b367-84ebc06fdff6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:16.340997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:16.380639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:16.381491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.381782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.382114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.386739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:16.388223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:16.390685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 119/239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:16.395531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:16.437873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92cce-d427-4efe-b618-6e4730dc492d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:16.456597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:16.476431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:16.477239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.477527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.477868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.489952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:16.498359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:16.499265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:16.500094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 121/240] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:16.505286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:16.631313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a5d1e-c3bf-4b9f-bbcc-f30053ce7502 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:16.664038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:16.700231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b5307-6ffd-4876-8658-cb0f4510b015 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:16.703045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:16.703917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.704372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.704820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.705740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:16.708128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:16.747980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:16.748658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.748952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.749254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.750015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:16.750337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:16.751756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:16.761001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 122/241] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:16.766453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:16.805451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 120/242] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:16 2022] POST /identity/v3/users => generated 293 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:08:16.876824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef2589-6a59-4061-8984-502a5907b8de None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:16.914190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c704e-b78f-4666-8df6-e4fda8a2f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:16.915113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c704e-b78f-4666-8df6-e4fda8a2f682 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:16.915409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c704e-b78f-4666-8df6-e4fda8a2f682 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:16.915999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c704e-b78f-4666-8df6-e4fda8a2f682 None admin] PATH_INFO: `/v3/users/63f9627ad4dc44559ebe697d397582f3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:16.931646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c704e-b78f-4666-8df6-e4fda8a2f682 None admin] RBAC: Authorizing `identity:get_user(user_id=63f9627ad4dc44559ebe697d397582f3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:16.933289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c704e-b78f-4666-8df6-e4fda8a2f682 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:16.935204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 123/243] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:16 2022] GET /identity/v3/users/63f9627ad4dc44559ebe697d397582f3 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:16.941019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:17.061191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:17.108750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234fee-faa7-4fb8-b391-daff2364bd01 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:17.153426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:17.154111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.154396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.154671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.228387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:17.229791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:17.314857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:17.325228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cd039-2347-49ca-9d7e-fb9976005302 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.326141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cd039-2347-49ca-9d7e-fb9976005302 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.326583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cd039-2347-49ca-9d7e-fb9976005302 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.328438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 124/244] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:17.333838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.334167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.334454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.337759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 121/245] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:17.344749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:17.345967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:17.360598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:17.361936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:17.438930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 125/246] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:17.450288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c94e0-0dad-4758-88c5-d9527aae9cad None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:17.466044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:17.485693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:17.486569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.486847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.487168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.488360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:17.489899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:17.491931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 122/247] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:17 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:17.511489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:17.566541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:17.579407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1081fc-990e-4ccf-b7a6-f3805735f50a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:17.621585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:17.636941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e3fb-bb0a-4ac3-8123-a55edcee6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:17.637820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e3fb-bb0a-4ac3-8123-a55edcee6f4a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.638167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e3fb-bb0a-4ac3-8123-a55edcee6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.638444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e3fb-bb0a-4ac3-8123-a55edcee6f4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.643029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659be3-8b09-40be-809a-3252eb668854 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:17.658919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e3fb-bb0a-4ac3-8123-a55edcee6f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9984e3fb-bb0a-4ac3-8123-a55edcee6f4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:17.668421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:17.669327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:17.670177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:17.671282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 126/248] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:17.672487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2954-6a40-49bf-89c1-6fb50d96ca98 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.672781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2954-6a40-49bf-89c1-6fb50d96ca98 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.673060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2954-6a40-49bf-89c1-6fb50d96ca98 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.674495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 127/249] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:17.679366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2954-6a40-49bf-89c1-6fb50d96ca98 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:17.680370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:17.681034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.681315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.682216 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.683064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] RBAC: Adding query filter params (role.id=af08a486fc834d47979805f78c4d9703, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=63f9627ad4dc44559ebe697d397582f3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:17.683377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:17.684889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4835e4-77da-4d66-abb1-4ec363156dfd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:17.691258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 123/250] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:17 2022] GET /identity/v3/role_assignments?user.id=63f9627ad4dc44559ebe697d397582f3&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=af08a486fc834d47979805f78c4d9703 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:17.692602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.692897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.693856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.711378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:17.712586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:17.811722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 124/251] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:17.840467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:17.879747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2954-6a40-49bf-89c1-6fb50d96ca98 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:17.889706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:17.965778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:17.966488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:17.966783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:17.967168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:17.967940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:17.968256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:17.969675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:17.993574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 128/252] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:18.003788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.017954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21721c50-ae04-4a72-bf3a-36350c9b55d2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:18.082212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:18.082824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.083088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.083374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.115062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:18.119638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:18.125574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:18.126582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:18.127372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 125/253] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:18.131797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.217738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394d5f-d637-4a0e-a8e8-f600ee6264f1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:18.269124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ac50d-dd8c-4da4-b51b-d5c9d4c0aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:18.270030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac50d-dd8c-4da4-b51b-d5c9d4c0aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.270326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac50d-dd8c-4da4-b51b-d5c9d4c0aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.270606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac50d-dd8c-4da4-b51b-d5c9d4c0aaa7 None admin] PATH_INFO: `/v3/users/594cd03837c049cfb3cf1f9f907b9ddb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.274774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ac50d-dd8c-4da4-b51b-d5c9d4c0aaa7 None admin] RBAC: Authorizing `identity:get_user(user_id=594cd03837c049cfb3cf1f9f907b9ddb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:18.276279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ac50d-dd8c-4da4-b51b-d5c9d4c0aaa7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:18.278341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 129/254] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:18 2022] GET /identity/v3/users/594cd03837c049cfb3cf1f9f907b9ddb => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:18.279675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077a1a-bd56-4040-be5d-7a201dfaa4cb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.279962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077a1a-bd56-4040-be5d-7a201dfaa4cb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.280241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077a1a-bd56-4040-be5d-7a201dfaa4cb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.281768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 130/255] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:18.285042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9077a1a-bd56-4040-be5d-7a201dfaa4cb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.344222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:18.351894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c94c5-229b-4d8b-b29a-58fb61268384 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:18.405847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9077a1a-bd56-4040-be5d-7a201dfaa4cb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:18.438185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:18.449134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190940f-fdc6-4132-bb47-3e4a9fabc6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:18.450146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190940f-fdc6-4132-bb47-3e4a9fabc6aa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.450505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190940f-fdc6-4132-bb47-3e4a9fabc6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.450856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190940f-fdc6-4132-bb47-3e4a9fabc6aa None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.452162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:18.452294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190940f-fdc6-4132-bb47-3e4a9fabc6aa None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:18.452835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.453119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.453399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.454036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190940f-fdc6-4132-bb47-3e4a9fabc6aa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:18.454190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:18.454501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:18.456181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:18.456317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 131/256] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:18 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:18.457378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.457675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.458038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.477166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 126/257] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:18.478016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.489838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:18.491069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:18.580480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 132/258] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:18.581346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.683708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c44f5-4ade-4da2-9e08-ee7fbe29ec00 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:18.751996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:18.752890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.753171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.753446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112/users/594cd03837c049cfb3cf1f9f907b9ddb/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.756700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] RBAC: Authorizing `identity:create_grant(project_id=9060c5c191c541fa8daff8f02e043112, user_id=594cd03837c049cfb3cf1f9f907b9ddb, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:18.758199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:18.778535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49023b-6cd4-4e21-af2c-721f9e676d5a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:18.800654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:18.815495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:18.816374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:18.816661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:18.816942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] PATH_INFO: `/v3/users/daf3e9e8572442d5878541452cdf7a22` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:18.818208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] RBAC: Authorizing `identity:get_user(user_id=daf3e9e8572442d5878541452cdf7a22)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:18.819732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:18.821436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 133/259] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:18 2022] GET /identity/v3/users/daf3e9e8572442d5878541452cdf7a22 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:18.822351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.860372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 127/260] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:18 2022] PUT /identity/v3/projects/9060c5c191c541fa8daff8f02e043112/users/594cd03837c049cfb3cf1f9f907b9ddb/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:18.860984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:18.911612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:18.983049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7d54f-4963-4a4b-badd-21182ea41e1d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.052307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.053133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.053422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.053701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.067557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94586772-3ff2-4998-86ac-12d5ab51914f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.079457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:19.087793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:19.088676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:19.090394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 134/261] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:19.100732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:19.149077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.149728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.150062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.151287 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.200695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:19.257642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:19.259093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:19.284199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c6187-4097-4ea4-9158-a73af98c81a7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.300647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:19.337604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.338881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.339169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.339453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.340216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:19.340530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:19.341933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:19.364713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 135/262] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:19.370485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:19.423708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 128/263] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:19.428716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:19.530950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2da36b-c80c-4b95-a235-b1b0d4e95780 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.540107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e24f-a794-41e3-aa95-493b4156e871 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.541986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:19.566331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:19.577773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.579872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.580174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.580458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.581674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:19.582690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.583203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:19.583586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.583875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.584160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] PATH_INFO: `/v3/users/daf3e9e8572442d5878541452cdf7a22` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.585337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 129/264] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:19 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:19.585464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] RBAC: Authorizing `identity:get_user(user_id=daf3e9e8572442d5878541452cdf7a22)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:19.586873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:19.588557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 136/265] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:19 2022] GET /identity/v3/users/daf3e9e8572442d5878541452cdf7a22 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:19.594059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:19.594870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:19.755110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f0083-a1ce-425e-b463-308a687a9875 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.760179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade49bfa-d589-4d87-a083-d12045a63332 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:19.789445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.790043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.790335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.790616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.854410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:19.861010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:19.862722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:19.869783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:19.886932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:19.886932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:19.886932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:19.886932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=daf3e9e8572442d5878541452cdf7a22) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:19.886932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:19.886932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:19.889268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 137/266] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:19 2022] GET /identity/v3/role_assignments?user.id=daf3e9e8572442d5878541452cdf7a22&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:20.011295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 130/267] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:20.017085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:20.095608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:20.176211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef442-ecdc-4ee5-908b-09d297243933 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:20.218959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cba04-80bf-4947-986d-7876426df88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:20.219833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cba04-80bf-4947-986d-7876426df88f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.220121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cba04-80bf-4947-986d-7876426df88f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.220402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cba04-80bf-4947-986d-7876426df88f None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.221624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cba04-80bf-4947-986d-7876426df88f None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:20.223117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cba04-80bf-4947-986d-7876426df88f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:20.225161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 138/268] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:20 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:20.231379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:20.247943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99964088-ffa2-4c5e-92e6-0a3bcc8d88f1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.248158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99964088-ffa2-4c5e-92e6-0a3bcc8d88f1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.248373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99964088-ffa2-4c5e-92e6-0a3bcc8d88f1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.249739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 139/269] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:20.255110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab961-eb56-414a-9af3-8ac0c37a3acc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.255407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab961-eb56-414a-9af3-8ac0c37a3acc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.255698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab961-eb56-414a-9af3-8ac0c37a3acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.287470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-68eab961-eb56-414a-9af3-8ac0c37a3acc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:20.288918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68eab961-eb56-414a-9af3-8ac0c37a3acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:20.368052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:20.382811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08951ebe-e91d-4097-b47f-d55cb95b4dbf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:20.401083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 140/270] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:20.402409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db31b-a58f-4d8a-8e9b-03500452b78d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.402708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db31b-a58f-4d8a-8e9b-03500452b78d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.402992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db31b-a58f-4d8a-8e9b-03500452b78d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.404410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 141/271] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:20.410570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.410865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.411269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.435191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:20.436408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:20.446127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:20.447723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.447723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.447977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.448880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] RBAC: Adding query filter params (role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=daf3e9e8572442d5878541452cdf7a22) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:20.449199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:20.450804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:20.459483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 131/272] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:20 2022] GET /identity/v3/role_assignments?user.id=daf3e9e8572442d5878541452cdf7a22&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:20.460572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:20.506895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:20.584341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 142/273] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:20.609377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:20.626904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56a02-6da3-4375-8908-678b0158f850 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:20.693546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:20.694020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.694318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.694598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.709822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:20.719353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:20.720282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:20.721064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 132/274] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:20.726359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:20.753723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:20.773753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735c778-188b-4dd8-94f2-f8f4b60ab3d5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:20.813379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb5258-78e4-4af8-a885-3d885d23cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:20.814358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb5258-78e4-4af8-a885-3d885d23cb6a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.814740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb5258-78e4-4af8-a885-3d885d23cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.815114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb5258-78e4-4af8-a885-3d885d23cb6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.816482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb5258-78e4-4af8-a885-3d885d23cb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:20.818061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb5258-78e4-4af8-a885-3d885d23cb6a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:20.819600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 143/275] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:20.820795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7629-6ed4-4446-be24-ea1f2a0e2eda None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.821077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7629-6ed4-4446-be24-ea1f2a0e2eda None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.821354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7629-6ed4-4446-be24-ea1f2a0e2eda None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.823086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 144/276] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:20.826758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7629-6ed4-4446-be24-ea1f2a0e2eda None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:20.867973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b093b-f0e5-4634-9f3c-73e4f94f3573 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:20.871982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:20.903258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:20.903977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.904259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.904536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.910449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:20.910449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:20.910449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8aaa8-9845-4d83-9246-9dcefdfe9fdb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:20.920342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 133/277] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:20.920342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:20.920342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:20.920342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:20.934173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:20.935354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:20.940073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7629-6ed4-4446-be24-ea1f2a0e2eda None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.006129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.006812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.007106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.007390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.008129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:21.009587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:21.043567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 134/278] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:21.044422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.059442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.094824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 145/279] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:20 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:08:21.095786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.191811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971db0-c0e1-45f7-a6e4-238442d42c24 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.227025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.235041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c831fdf-9ec1-4ecd-b0e6-a9c0993632fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.248149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.250100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.250557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.251146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] PATH_INFO: `/v3/users/c484de7053354dbe9cba731ca67f7eca` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.268408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] RBAC: Authorizing `identity:get_user(user_id=c484de7053354dbe9cba731ca67f7eca)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:21.270204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:21.272486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 135/280] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/users/c484de7053354dbe9cba731ca67f7eca => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:21.277342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.278154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.278444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.282362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.282478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.290761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:21.298534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:21.299692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:21.300484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 146/281] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:21.307253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.355460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.399499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556bdc-8f9b-43f1-9360-b0be56f61546 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.443212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a323-c419-4c96-9c8e-447324c2f3fc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.447638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.447638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.447861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.448093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.449003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, user.id=c484de7053354dbe9cba731ca67f7eca, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:21.449325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:21.450821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:21.457663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 136/282] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/role_assignments?user.id=c484de7053354dbe9cba731ca67f7eca&scope.system=all&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:21.490219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.491325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.491803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.492473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.493449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:21.494543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:21.496255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:21.506531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 147/283] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:21.511754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.636059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304e5a1-e926-4fc0-82e8-08b7cb3777cb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.665532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.674292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178002c9-741d-4414-8839-f83b8748e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.675217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178002c9-741d-4414-8839-f83b8748e01c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.675502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178002c9-741d-4414-8839-f83b8748e01c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.675777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178002c9-741d-4414-8839-f83b8748e01c None admin] PATH_INFO: `/v3/users/63f9627ad4dc44559ebe697d397582f3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.677162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178002c9-741d-4414-8839-f83b8748e01c None admin] RBAC: Authorizing `identity:get_user(user_id=63f9627ad4dc44559ebe697d397582f3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:21.678748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178002c9-741d-4414-8839-f83b8748e01c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:21.680612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 137/284] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/users/63f9627ad4dc44559ebe697d397582f3 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:21.688568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.709925 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.722979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcf15-d74f-471b-bd53-9091aab06be3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.723262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcf15-d74f-471b-bd53-9091aab06be3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.723538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddcf15-d74f-471b-bd53-9091aab06be3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.729014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 138/285] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:21.735523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.735813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.736096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.772368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:21.773563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:21.836017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f60a24-114d-47c0-bb00-7175bf71067b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:21.856506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 139/286] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:21.881841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.951397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:21.952291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:21.952582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:21.952862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:21.954116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:21.955611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:21.962113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 148/287] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:21.963575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:21.997752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d7e00-a575-404d-84c4-f8f25d11ce2f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:22.026964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:22.037404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:22.038908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:22.039379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:22.039774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:22.053257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:22.063690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:22.064606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:22.065389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:22.068028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 140/288] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:22.073902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:22.179784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:22.193505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736529a0-816f-436f-aabb-09126520bc8b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:22.224104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541253a-b495-4a1d-9300-8b170470b0b0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:22.232430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:22.233466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:22.233941 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:22.234450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:22.235440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:22.236477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:22.238104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:22.252194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 141/289] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:22.259094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:22.296588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:22.297482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:22.297766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:22.298067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112/users/63f9627ad4dc44559ebe697d397582f3/roles/af08a486fc834d47979805f78c4d9703` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:22.301091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] RBAC: Authorizing `identity:create_grant(project_id=9060c5c191c541fa8daff8f02e043112, user_id=63f9627ad4dc44559ebe697d397582f3, role_id=af08a486fc834d47979805f78c4d9703)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:22.302583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:22.338456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:22.373859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 149/290] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:21 2022] PUT /identity/v3/projects/9060c5c191c541fa8daff8f02e043112/users/63f9627ad4dc44559ebe697d397582f3/roles/af08a486fc834d47979805f78c4d9703 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:08:22.402412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a25936-4e96-4058-ad1a-0711db2a5ae4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:22.439786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:22.440711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:22.440998 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:22.441277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] PATH_INFO: `/v3/users/594cd03837c049cfb3cf1f9f907b9ddb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:22.442520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] RBAC: Authorizing `identity:get_user(user_id=594cd03837c049cfb3cf1f9f907b9ddb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:22.444031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:22.446120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 142/291] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:22 2022] GET /identity/v3/users/594cd03837c049cfb3cf1f9f907b9ddb => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:22.455292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:22.590775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19aebc-50aa-46ec-ac1c-d13dd955264f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:22.626309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:22.626961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:22.627246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:22.627521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:22.642240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:22.710775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:22.712319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:22.838224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 150/292] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:22.847237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:23.017761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3fae4-b11d-4a67-86fd-150154752f43 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:23.035022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:23.059946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402117-f3e0-43e6-8bf7-59067843adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:23.060806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402117-f3e0-43e6-8bf7-59067843adcd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.061097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402117-f3e0-43e6-8bf7-59067843adcd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.061380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402117-f3e0-43e6-8bf7-59067843adcd None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.063540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402117-f3e0-43e6-8bf7-59067843adcd None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:23.065010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402117-f3e0-43e6-8bf7-59067843adcd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:23.066862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 143/293] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:22 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:23.073343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:23.145374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:23.214207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8b4f0-fba6-41fb-8326-5c43f8fdaaf1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:23.260554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:23.261214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.261498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.261774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.262657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=594cd03837c049cfb3cf1f9f907b9ddb) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:23.262974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:23.264416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832049c-0433-4f4e-9a1f-a69947fd9307 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:23.272190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 151/294] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:23 2022] GET /identity/v3/role_assignments?user.id=594cd03837c049cfb3cf1f9f907b9ddb&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:23.638632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a1e6-0448-43a0-a371-84065eed58ef None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.639139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a1e6-0448-43a0-a371-84065eed58ef None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.639213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a1e6-0448-43a0-a371-84065eed58ef None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.640806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 144/295] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:23.646228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320887f-7f7a-4357-aed9-d087a141cd95 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.646522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320887f-7f7a-4357-aed9-d087a141cd95 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.646807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320887f-7f7a-4357-aed9-d087a141cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.667356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9320887f-7f7a-4357-aed9-d087a141cd95 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:23.668557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9320887f-7f7a-4357-aed9-d087a141cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:23.749709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 152/296] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:23.773295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a1e6-0448-43a0-a371-84065eed58ef None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:23.892756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a1e6-0448-43a0-a371-84065eed58ef None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:23.929967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4dd4-fbff-4e28-adae-a696855cc240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:23.931124 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4dd4-fbff-4e28-adae-a696855cc240 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.931700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4dd4-fbff-4e28-adae-a696855cc240 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.932129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4dd4-fbff-4e28-adae-a696855cc240 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.932228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6db656-0506-4a06-acfe-6cfa76e4840b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.932468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6db656-0506-4a06-acfe-6cfa76e4840b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.932760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6db656-0506-4a06-acfe-6cfa76e4840b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.938024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 153/297] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:23.939648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28086ee-0004-4030-89ee-b47d9c8ab93a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.939990 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28086ee-0004-4030-89ee-b47d9c8ab93a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.940223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28086ee-0004-4030-89ee-b47d9c8ab93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.944345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4dd4-fbff-4e28-adae-a696855cc240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f66c4dd4-fbff-4e28-adae-a696855cc240 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:23.952161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:23.953059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 145/298] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:23.954807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715db93-a1f1-4c68-978f-2a9bde7d3e94 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:23.955552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715db93-a1f1-4c68-978f-2a9bde7d3e94 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:23.955552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715db93-a1f1-4c68-978f-2a9bde7d3e94 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:23.956675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 146/299] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:23.958713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715db93-a1f1-4c68-978f-2a9bde7d3e94 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:23.960557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b28086ee-0004-4030-89ee-b47d9c8ab93a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:23.962267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b28086ee-0004-4030-89ee-b47d9c8ab93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:23.994319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.009039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.033794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 154/300] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:24.039620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91376d-6086-473b-8943-100ca5000838 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.039910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91376d-6086-473b-8943-100ca5000838 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.040481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91376d-6086-473b-8943-100ca5000838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.063872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ba91376d-6086-473b-8943-100ca5000838 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:24.065406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba91376d-6086-473b-8943-100ca5000838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:24.073311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715db93-a1f1-4c68-978f-2a9bde7d3e94 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.113611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.114720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.115022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.115286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.116042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:24.116350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.117753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.127098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 147/301] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:24.127887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.158034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 155/302] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:24.158034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91376d-6086-473b-8943-100ca5000838 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.235981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd7b2f-602c-402f-8369-9350a7986336 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.245899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.259671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.264001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91376d-6086-473b-8943-100ca5000838 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.275183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.275969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.276256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.276536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.286955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:24.295322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:24.296196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:24.297094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:24.300099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.301096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.301501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.301632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 148/303] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:24.301776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] PATH_INFO: `/v3/users/f043004e940647edbed399577137fca9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.302544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.316139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] RBAC: Authorizing `identity:get_user(user_id=f043004e940647edbed399577137fca9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.317617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.323912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 156/304] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:24 2022] GET /identity/v3/users/f043004e940647edbed399577137fca9 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:24.323912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.410272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c96d8c-94b3-48e0-87c8-b0ca84ae7bb4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.423523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70971295-9a32-42d1-acf3-036abec3a05c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.448943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.449733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.450030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.450316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.451493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.452951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.454585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 149/305] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:24.455344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.467158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.468396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.468876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.469510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.470843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:24.471589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.473604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.485324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 157/306] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:24.487088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.489153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.508226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.559500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d3bf0-caba-4e1a-92dc-4c282db9c18d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.596492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.597147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.597485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.597727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.598562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] RBAC: Adding query filter params (role.id=af08a486fc834d47979805f78c4d9703, user.id=f043004e940647edbed399577137fca9, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:24.598884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.600379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.602961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071fbd8-75b2-4599-accc-77b1b90c1004 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.605843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 150/307] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jun 20 12:08:24 2022] GET /identity/v3/role_assignments?user.id=f043004e940647edbed399577137fca9&scope.system=all&role.id=af08a486fc834d47979805f78c4d9703 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:24.606164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.661196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.662439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.663141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.663571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] PATH_INFO: `/v3/groups` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.664811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.667447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.736223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.741516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf807-566b-434e-a7e7-39f060b0b6c0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.770496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 158/308] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Jun 20 12:08:24 2022] POST /identity/v3/groups => generated 229 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:24.792794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbf92b-b310-4081-8d63-208ac54e7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.794116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbf92b-b310-4081-8d63-208ac54e7a13 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.794604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbf92b-b310-4081-8d63-208ac54e7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.795133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbf92b-b310-4081-8d63-208ac54e7a13 None admin] PATH_INFO: `/v3/users/c484de7053354dbe9cba731ca67f7eca` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.796786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbf92b-b310-4081-8d63-208ac54e7a13 None admin] RBAC: Authorizing `identity:get_user(user_id=c484de7053354dbe9cba731ca67f7eca)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.798583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbf92b-b310-4081-8d63-208ac54e7a13 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:24.800602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 151/309] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:24 2022] GET /identity/v3/users/c484de7053354dbe9cba731ca67f7eca => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:24.807249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:24.907969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:24.936102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20085dea-4ea7-4981-80b1-bbd2e3f0c5f0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:24.971176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:24.972061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:24.972353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:24.972635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] PATH_INFO: `/v3/system/users/c484de7053354dbe9cba731ca67f7eca/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:24.974800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c484de7053354dbe9cba731ca67f7eca, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:24.976441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:25.033052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db5461-78c6-480f-b54d-10c971e5248a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:25.033395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db5461-78c6-480f-b54d-10c971e5248a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:25.033671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db5461-78c6-480f-b54d-10c971e5248a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:25.035133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 152/310] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:25.041200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:25.043597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:25.043597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:25.059026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:25.060215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:25.065471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 159/311] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Jun 20 12:08:24 2022] PUT /identity/v3/system/users/c484de7053354dbe9cba731ca67f7eca/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:08:25.162401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 153/312] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:25.195804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:25.323060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa4a4d-c03d-4590-894a-d3e3a0551c90 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:25.360011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:25.360819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:25.361111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:25.361395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:25.372552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:25.380427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:25.381357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:25.382236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 160/313] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:25.389178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:25.487077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:25.492854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28ca4d-308e-43a2-b28c-adda9b3ce875 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:25.538353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:25.539750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:25.540109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:25.540395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:25.541741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:25.542085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:25.543488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:25.552458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 154/314] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:25.558066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:25.562603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:25.672676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a10ef-c030-4cbd-8e7a-6182035b4720 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:25.709027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:25.710239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:25.710745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:25.711288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] PATH_INFO: `/v3/users/63f9627ad4dc44559ebe697d397582f3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:25.713302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] RBAC: Authorizing `identity:get_user(user_id=63f9627ad4dc44559ebe697d397582f3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:25.715038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:25.717249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 161/315] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:25 2022] GET /identity/v3/users/63f9627ad4dc44559ebe697d397582f3 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:25.722374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:25.829295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7533ac9-bf86-4c02-8549-429a97ab422f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:25.864137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:25.864792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:25.865083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:25.865364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:25.894365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:25.936314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:25.937793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:26.041048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 155/316] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:26.046554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:26.127920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:26.161628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4a78-5ef6-4aa9-be39-539de6ed945c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:26.198136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc07b28-06c7-4bd6-82ee-d316dd51dd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:26.199204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07b28-06c7-4bd6-82ee-d316dd51dd47 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:26.199646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07b28-06c7-4bd6-82ee-d316dd51dd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:26.200066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07b28-06c7-4bd6-82ee-d316dd51dd47 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:26.201379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc07b28-06c7-4bd6-82ee-d316dd51dd47 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:26.203034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc07b28-06c7-4bd6-82ee-d316dd51dd47 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:26.205170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 162/317] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:26 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:26.210566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:26.273129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:26.316519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2559c4-3401-4ff4-a638-d8cf56635631 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:26.352160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:26.352825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:26.353132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:26.353419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:26.354278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] RBAC: Adding query filter params (role.id=af08a486fc834d47979805f78c4d9703, scope.project.id=9060c5c191c541fa8daff8f02e043112, user.id=63f9627ad4dc44559ebe697d397582f3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:26.354597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:26.356056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9c21e-dd96-4242-92ce-cd64fe06589a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:26.362107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 156/318] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:26 2022] GET /identity/v3/role_assignments?user.id=63f9627ad4dc44559ebe697d397582f3&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=af08a486fc834d47979805f78c4d9703 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:26.702403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4776bef-1ee7-42a5-9ded-b111c2c431d9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:26.702795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4776bef-1ee7-42a5-9ded-b111c2c431d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:26.702992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4776bef-1ee7-42a5-9ded-b111c2c431d9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:26.704495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 163/319] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:26.709615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac96d9-f52d-4ac9-9551-04f65127fb0e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:26.709915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac96d9-f52d-4ac9-9551-04f65127fb0e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:26.710232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac96d9-f52d-4ac9-9551-04f65127fb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:26.730248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8aac96d9-f52d-4ac9-9551-04f65127fb0e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:26.731447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8aac96d9-f52d-4ac9-9551-04f65127fb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:26.802029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 157/320] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:26.824636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4776bef-1ee7-42a5-9ded-b111c2c431d9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:26.927838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f96f-87d7-4569-8cb2-0f1a4899148e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:26.928342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f96f-87d7-4569-8cb2-0f1a4899148e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:26.928442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f96f-87d7-4569-8cb2-0f1a4899148e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:26.929923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 158/321] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:26.935207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:26.935503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:26.935598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4776bef-1ee7-42a5-9ded-b111c2c431d9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:26.937647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:26.978348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:26.979472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:27.000969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.001774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.002146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.002432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.010021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.014776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:27.022415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:27.024166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:27.024999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:27.028732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 164/322] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:27.029671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.030048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.050092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 159/323] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:27.074358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.137723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6eef0-164b-46b8-9fc1-17eb8086cc08 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.174586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.175373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.175660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.176045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.176807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:27.177118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.178633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d1dc9-a541-4781-b885-6323f7b6c842 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.186187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cfca-9ba0-4e14-9e06-b4dc02cd0c5f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.188631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 165/324] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:27.189967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483d2e-6e06-4385-bd74-afe238dc9e92 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.190290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483d2e-6e06-4385-bd74-afe238dc9e92 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.190573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483d2e-6e06-4385-bd74-afe238dc9e92 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.191855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 166/325] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:27.193370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483d2e-6e06-4385-bd74-afe238dc9e92 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.221940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac419e1f-2d5c-4940-81c9-d5d9f1f3a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.223037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419e1f-2d5c-4940-81c9-d5d9f1f3a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.223327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419e1f-2d5c-4940-81c9-d5d9f1f3a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.223607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419e1f-2d5c-4940-81c9-d5d9f1f3a1e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.224904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac419e1f-2d5c-4940-81c9-d5d9f1f3a1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.226381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac419e1f-2d5c-4940-81c9-d5d9f1f3a1e3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.228000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 160/326] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:27.229770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.230015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.230294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.246561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:27.247734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:27.254346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.292836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.295150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483d2e-6e06-4385-bd74-afe238dc9e92 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.313715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 161/327] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:27.314544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.331035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.331904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.332181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.332463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] PATH_INFO: `/v3/users/f043004e940647edbed399577137fca9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.333637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] RBAC: Authorizing `identity:get_user(user_id=f043004e940647edbed399577137fca9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.335124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.336880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 167/328] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/users/f043004e940647edbed399577137fca9 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:27.338863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.413342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8552d-f252-460d-b338-bb4a8e6474eb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.437456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2c4c1-8560-48a8-b1d6-d2d8b3652e8c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.447486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.448145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.448426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.448698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] PATH_INFO: `/v3/groups` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.449372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.450928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.462291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.469666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.470476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.470758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.471032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.481294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:27.488876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:27.490045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 168/329] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:27.490890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.539817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 162/330] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Jun 20 12:08:27 2022] POST /identity/v3/groups => generated 226 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:27.541266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.588111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.603833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f78c5-354a-4d0b-bdb3-8cba38f18540 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.641194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.642103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.642390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.642767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] PATH_INFO: `/v3/system/users/f043004e940647edbed399577137fca9/roles/af08a486fc834d47979805f78c4d9703` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.644348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f043004e940647edbed399577137fca9, role_id=af08a486fc834d47979805f78c4d9703)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.645774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.654883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac896-0624-47cb-9b6c-cbca1708a4dc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.691447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.692119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.692404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.692684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.693467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:27.693778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.695258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.703737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 163/331] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:27.709095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.717435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 169/332] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Jun 20 12:08:27 2022] PUT /identity/v3/system/users/f043004e940647edbed399577137fca9/roles/af08a486fc834d47979805f78c4d9703 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:27.827176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebda7e-f9a1-4eba-90a3-44df82436998 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:27.828923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.867514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a843f-2fac-4191-9126-8c3efa41a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:27.868446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a843f-2fac-4191-9126-8c3efa41a6dd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:27.868757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a843f-2fac-4191-9126-8c3efa41a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:27.869031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a843f-2fac-4191-9126-8c3efa41a6dd None admin] PATH_INFO: `/v3/users/c484de7053354dbe9cba731ca67f7eca` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:27.870472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a843f-2fac-4191-9126-8c3efa41a6dd None admin] RBAC: Authorizing `identity:get_user(user_id=c484de7053354dbe9cba731ca67f7eca)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:27.871999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a843f-2fac-4191-9126-8c3efa41a6dd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:27.874079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 164/333] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/users/c484de7053354dbe9cba731ca67f7eca => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:27.881705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:27.944218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:27.992133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9774-aee5-48a9-ab9a-c20539bd0c17 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:28.027592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:28.028265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:28.028553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:28.028835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:28.029677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] RBAC: Adding query filter params (role.id=5deb6d93e9c34f3bbfcf82d23e06790e, user.id=c484de7053354dbe9cba731ca67f7eca, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:28.030068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:28.031471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82122b-e3af-4e06-8c5c-d44e4b1fe886 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:28.048813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 170/334] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jun 20 12:08:27 2022] GET /identity/v3/role_assignments?user.id=c484de7053354dbe9cba731ca67f7eca&scope.system=all&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:30.145664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57310a0-cb76-4eb2-8535-158d6949623f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.145664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57310a0-cb76-4eb2-8535-158d6949623f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.145664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57310a0-cb76-4eb2-8535-158d6949623f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.146766 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 165/335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:30.150931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3fd00-c09d-4f4d-b77f-f7f858e04804 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.151749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3fd00-c09d-4f4d-b77f-f7f858e04804 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.152217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3fd00-c09d-4f4d-b77f-f7f858e04804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.159538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36891bc-1d88-405f-8f5b-f19360388c8d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.160108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36891bc-1d88-405f-8f5b-f19360388c8d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.160576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36891bc-1d88-405f-8f5b-f19360388c8d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.162410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 166/336] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:30.173477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.174120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.174619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.178631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4db3fd00-c09d-4f4d-b77f-f7f858e04804 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:30.179850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4db3fd00-c09d-4f4d-b77f-f7f858e04804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:30.203006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:30.204529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:30.308594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 171/337] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:30.310082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b6ab-74a1-4a22-b802-e88edf2ba8cb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.310376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b6ab-74a1-4a22-b802-e88edf2ba8cb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.310659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b6ab-74a1-4a22-b802-e88edf2ba8cb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.312180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 172/338] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:30.318841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.319136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.319423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.321539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 167/339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:30.347818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:30.349011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:30.362013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:30.399543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:30.453158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 173/340] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:30.454070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:30.506684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:30.511997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df11664-f6e2-4701-bb06-613fd1a394d3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:30.559428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:30.560635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.561058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.561478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.578444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:30.586223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:30.587108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:30.589654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 168/341] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:30.591223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65332fcc-e270-4c39-8e48-600ee170d5dc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:30.594055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:30.632919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:30.633725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.634024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.634346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.658725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:30.670708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:30.673012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 174/342] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:30.674947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:30.708982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:30.793694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cead76f-d421-430a-b657-7454b19c2a01 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:30.815628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3c6dd-0e77-4b87-862b-3648b6a9e51b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:30.831875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:30.832666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.832957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.833240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.834143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:30.834330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:30.835712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:30.846802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 175/343] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:30.847509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:30.882799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:30.883630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:30.883916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:30.884331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:30.906135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:30.919162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:30.920059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:30.920931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:30.923904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 169/344] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:30.924917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:30.946374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:30.956160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec715-a4b6-4483-86d7-5a95181d27b1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:30.977331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:30.998710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:30.999633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.000019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.000583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.001708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:31.002305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:31.004088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:31.015437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 176/345] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:31.016460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.122395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323c3fc-e568-43c5-b67e-b7a5249ad58a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.149326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44f1c-614b-485f-857a-b26e47c4ab84 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.184193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:31.185061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.185455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.185742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] PATH_INFO: `/v3/users/f043004e940647edbed399577137fca9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.187114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] RBAC: Authorizing `identity:get_user(user_id=f043004e940647edbed399577137fca9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:31.188825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:31.188944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:31.189515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.189808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.190127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.190882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 170/346] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:08:30 2022] GET /identity/v3/users/f043004e940647edbed399577137fca9 => generated 293 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:31.191004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:31.191192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:31.191768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.192721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b889-993b-4e43-824e-a75859e55ba3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:31.203226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 177/347] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:31.209203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe7c6-af30-4ced-a8e5-758a7af53657 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.209203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe7c6-af30-4ced-a8e5-758a7af53657 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.209203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe7c6-af30-4ced-a8e5-758a7af53657 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.209203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 178/348] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:31.209203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe7c6-af30-4ced-a8e5-758a7af53657 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.229463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:31.315661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:31.325179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe7c6-af30-4ced-a8e5-758a7af53657 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.332748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46065fed-a06c-48d7-bc65-f1f5ea18ccb3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.364162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:31.364940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.365234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.365521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.366397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] RBAC: Adding query filter params (role.id=af08a486fc834d47979805f78c4d9703, user.id=f043004e940647edbed399577137fca9, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:31.366828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:31.368374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65d66-02f8-432b-8ad1-58ed66ddd0d8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:31.379801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:31.380581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.380875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.381304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.384488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 179/349] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/role_assignments?user.id=f043004e940647edbed399577137fca9&scope.system=all&role.id=af08a486fc834d47979805f78c4d9703 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:31.386021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.386327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.386610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.407335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:31.408592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:31.479484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:31.481078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:31.491558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 180/350] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:31.492661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.496605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:31.612827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7199c2-c8a4-402e-a63c-c90329ed0a18 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.642667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:31.653680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:31.654378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.654668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.654955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.656886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 171/351] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:31.660480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.756092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:31.757491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:31.760892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:31.785669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d68d-6a8d-4280-b711-6362957ae83f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.824914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:31.825719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:31.826016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:31.826306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:31.838937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:31.847050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:31.849165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 172/352] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:31.851065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.902501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 181/353] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:31.903359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:31.904924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:31.960877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4555b2d-ea41-42c5-85dc-bef06d99db28 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:31.999330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.000264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.000553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.000833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.002155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.003755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.005940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 173/354] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.006904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.010439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0402-ab93-4081-a0b0-f38cc014e01f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.012997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.048100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.048776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.049064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.049342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.050132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:32.050448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.051907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.061425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 182/355] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.062282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.115911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93641f3-7843-499e-bcfd-1150b660c13e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.136071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.155571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.156441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.156727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.157003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.158434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.159686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.162342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 174/356] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.163405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.187344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70177c98-ce8d-4e3a-9bbd-7024b5677899 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.233911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448527a-e608-4910-939a-41f1ee099a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.235597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448527a-e608-4910-939a-41f1ee099a09 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.236188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448527a-e608-4910-939a-41f1ee099a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.236665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448527a-e608-4910-939a-41f1ee099a09 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.248282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448527a-e608-4910-939a-41f1ee099a09 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.249959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448527a-e608-4910-939a-41f1ee099a09 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.251764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 183/357] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.253016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0551-5af7-4090-b7ce-b02c6a428b42 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.253309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0551-5af7-4090-b7ce-b02c6a428b42 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.253591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0551-5af7-4090-b7ce-b02c6a428b42 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.255132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 184/358] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:32.255848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0551-5af7-4090-b7ce-b02c6a428b42 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.290537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04033d52-f7eb-4785-ba34-9eef770ac504 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.295503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.332244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a456-d50a-4914-9929-079427781562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.332601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a456-d50a-4914-9929-079427781562 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.332893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a456-d50a-4914-9929-079427781562 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.333172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a456-d50a-4914-9929-079427781562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.379826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0551-5af7-4090-b7ce-b02c6a428b42 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.393526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.412219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a456-d50a-4914-9929-079427781562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.414538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a456-d50a-4914-9929-079427781562 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.421001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.421872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.422254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.422521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.423709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.425158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.427490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 185/359] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.427600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.536852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 175/360] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:32.536852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.537119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.537336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.548075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.550273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d12cd-590f-4647-9318-954c98648423 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.557159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:32.558419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:32.586782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.587830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.588756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.588938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.589902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:32.590621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.592165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879f281-e85d-418b-9a66-aaca8353ba0d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.598509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 186/361] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.599599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8949c7-58b4-487d-b8cd-03022141e157 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.599954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8949c7-58b4-487d-b8cd-03022141e157 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.600170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8949c7-58b4-487d-b8cd-03022141e157 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.604034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 187/362] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:32.610496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8949c7-58b4-487d-b8cd-03022141e157 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.650601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 176/363] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:32.651739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.669713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.758327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8949c7-58b4-487d-b8cd-03022141e157 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.784999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b46ef-71fd-4121-9a55-04d6d5218ce0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:32.814075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.814689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.814981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.815268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.816119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:32.816440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.817978 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bcb37-d43f-4bde-ad7f-7cf3ca7ce9bb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.825885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 188/364] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.827549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.828045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.828507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.838683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:32.839663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:32.840014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:32.840483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:32.841884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:32.843519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:32.846500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 177/365] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:32.854156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.858826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:32.860044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:32.888497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:32.953109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 189/366] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:32.954235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:32.981873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.005709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728e839-8d6a-4cf7-9923-59db29cbe2d4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.051842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.053206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.053711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.054233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.066773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:33.075349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:33.076247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:33.077063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:33.079493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 178/367] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:33.080500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.090695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b31622-dde2-48b2-a2b7-8563642e6503 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.149037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.150981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.151464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.151939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.153440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:33.155670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:33.160580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 190/368] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:32 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:33.160580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.192635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.207844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55deccf-8954-403f-b589-287172c8da87 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.252230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.253038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.253325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.253600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.267767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:33.276162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:33.277057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:33.277863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:33.278523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 179/369] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:33.279243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.283026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.291942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a009-1fa9-4fe3-ba6b-56e03c952678 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.330383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.331436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.331921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.332447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.333411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:33.333922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:33.335780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:33.346660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 191/370] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:33.347792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.408188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1a33-7f0c-465d-9bf9-6c13132a3007 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.447823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.450602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.451272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.451563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.451862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.452687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=9060c5c191c541fa8daff8f02e043112) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:33.453082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:33.454874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:33.464737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181e08-4fb4-4042-8f20-fde8f5ccdfb6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.466556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 180/371] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:33.467460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.505107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.506164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.506657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.507265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.508260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:33.508779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:33.511012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:33.521015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 192/372] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:33.527922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.583240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.649464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20004e-f627-48e5-ba24-a46aeff6dfe1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.655401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883c299-65a5-490c-9d19-d690fedbbd10 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:33.707416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.709609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.711623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.712447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.735523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:33.736557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:33.737635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:33.738930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:33.764390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.826259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:33.828171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:33.855080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:33.856526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:33.939439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 193/373] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:33.944714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:33.970185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:34.001161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:34.027555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 181/374] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:34.033181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:34.059699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1911dc-bef3-4515-8565-b1eda4f1f669 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:34.097077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:34.098408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:34.098897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:34.099437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] PATH_INFO: `/v3/projects/5236866843c24c419599ba663dbbb1be` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:34.100885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] RBAC: Authorizing `identity:get_project(project_id=5236866843c24c419599ba663dbbb1be)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:34.102730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:34.105002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 194/375] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:33 2022] GET /identity/v3/projects/5236866843c24c419599ba663dbbb1be => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:34.110146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:34.194428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d1320-38da-4c2e-bcb6-04bf2eafb392 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:34.239233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:34.240089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:34.240377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:34.240656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:34.243953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:34.245598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:34.254014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 182/376] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:34 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:34.254014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:34.306794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:34.338301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57280-59ed-429d-892d-a10680fbef9c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:34.377358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:34.380700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcae58-ce2b-4e4b-985a-dd0357af87cf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:34.418557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:34.419420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:34.419714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:34.419974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:34.423373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:34.424837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:34.426705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:34.427584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:34.427877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:34.428159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] PATH_INFO: `/v3/groups/fb266489fe2c47608a9bb7269e61ddc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:34.430097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 183/377] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:34 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:34.433130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:34.438654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] RBAC: Authorizing `identity:get_group(group_id=fb266489fe2c47608a9bb7269e61ddc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:34.440126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:34.442152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 195/378] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:34 2022] GET /identity/v3/groups/fb266489fe2c47608a9bb7269e61ddc8 => generated 229 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:34.454976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:34.543199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b66c-2c5c-41f1-9dd3-97a578e83ea4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:34.545913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:34.582298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:34.582965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:34.583253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:34.583537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:34.584456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=9060c5c191c541fa8daff8f02e043112) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:34.584778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:34.586504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82048c06-71d1-4000-ae6b-224a047e606d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:34.598140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 184/379] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:34 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:34.672101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab73e-2d5c-4c56-8d29-8eef17b2ac4e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:34.712402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:34.713083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:34.713374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:34.713663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:34.714553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] RBAC: Adding query filter params (group.id=fb266489fe2c47608a9bb7269e61ddc8, role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=5236866843c24c419599ba663dbbb1be) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:34.714875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:34.716361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4d3ea-9f29-4ae0-99fb-8dadee303cd7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:34.723338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 196/380] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:34 2022] GET /identity/v3/role_assignments?group.id=fb266489fe2c47608a9bb7269e61ddc8&scope.project.id=5236866843c24c419599ba663dbbb1be&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:35.199335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509c20-0ac6-40ba-b5ff-d9afccfa3367 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.199721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509c20-0ac6-40ba-b5ff-d9afccfa3367 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.199889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509c20-0ac6-40ba-b5ff-d9afccfa3367 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.201559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 185/381] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:35.210364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.210656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.210929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.234859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:35.236028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:35.283772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68ceb2-dcbe-4af5-aa13-3c85fb95fe96 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.284197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68ceb2-dcbe-4af5-aa13-3c85fb95fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.284614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68ceb2-dcbe-4af5-aa13-3c85fb95fe96 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.287007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:35.287196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 186/382] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:35.294985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.295686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.296133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.327626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:35.328843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:35.343985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 197/383] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:35.373520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:35.424436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 187/384] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:35.459067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:35.577762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d3ac-9271-40f3-88d8-33af488b38f8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:35.606108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a3297-55d1-4cff-999f-5b393255e66a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:35.610314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:35.615766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:35.616568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.616856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.617134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.629948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:35.638153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:35.639058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:35.639895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 198/385] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:35.645470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:35.671723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:35.672554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.672840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.673122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.685468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:35.695585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:35.717513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:35.718561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:35.719384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 188/386] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:35.724781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:35.757456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c09a0-5116-4e30-85f2-fa7aa3f45dde None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:35.796888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:35.797569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.797897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.798216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.798982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:35.799292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:35.801800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:35.811537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 199/387] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:35.816839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:35.901879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4db691-3b26-4e70-8fa0-a93d8f53c731 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:35.926374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dddc0-aa0e-4d93-84d8-7c230309ee49 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:35.934357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:35.959350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:35.960036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.960322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.960603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.961360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:35.961675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:35.963693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:35.963988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:35.964860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:35.965147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:35.965429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:35.966658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:35.968100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:35.970131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 200/388] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:35.976205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:35.981306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 189/389] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:35.986847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:36.026385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:36.115161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a1762-1fbf-43f9-abd6-88f830c1fa71 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:36.157075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:36.157878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.158189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.158469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.161388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:36.162870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:36.164842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 201/390] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:36.172293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:36.196397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb14d-d3d7-4f41-b7fa-30027d28cbf5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:36.205567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:36.263738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2933-2661-4174-8480-c088cb5548eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:36.264633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2933-2661-4174-8480-c088cb5548eb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.264921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2933-2661-4174-8480-c088cb5548eb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.265200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2933-2661-4174-8480-c088cb5548eb None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.268026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2933-2661-4174-8480-c088cb5548eb None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:36.269545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2933-2661-4174-8480-c088cb5548eb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:36.272056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 190/391] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:35 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:36.272629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de21c1-8a3a-464f-adb2-47ce6e4c95b4 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.272922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de21c1-8a3a-464f-adb2-47ce6e4c95b4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.273215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de21c1-8a3a-464f-adb2-47ce6e4c95b4 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.275437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 191/392] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:36.281578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de21c1-8a3a-464f-adb2-47ce6e4c95b4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:36.286083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c1f1b-7bad-46d7-8a6d-1ff4f822dd9d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:36.331382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c21c7-30a0-4e08-8412-ca0c57b795fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:36.332280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c21c7-30a0-4e08-8412-ca0c57b795fa None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.332563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c21c7-30a0-4e08-8412-ca0c57b795fa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.332844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c21c7-30a0-4e08-8412-ca0c57b795fa None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/groups/e55a38c213d445258cdc8b07dde95d70/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.335402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c21c7-30a0-4e08-8412-ca0c57b795fa None admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e4753a6444d1b6c9f4ab90239a4e, group_id=e55a38c213d445258cdc8b07dde95d70, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:36.336859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c21c7-30a0-4e08-8412-ca0c57b795fa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:36.401141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:36.417322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 202/393] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jun 20 12:08:36 2022] PUT /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/groups/e55a38c213d445258cdc8b07dde95d70/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:08:36.418466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.418760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.419047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.430141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de21c1-8a3a-464f-adb2-47ce6e4c95b4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:36.438262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:36.439464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:36.482031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:36.482905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.483194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.483472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.484737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:36.486288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:36.488351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 192/394] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:36 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:36.494353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:36.530773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 203/395] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:36.554638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:36.597705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:36.712547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616bcd-edd8-4df9-b056-201beabdc058 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:36.736154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de98d-d8bc-451c-af84-845f3e562ec0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:36.767471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:36.768412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.768748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.769033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/groups/e55a38c213d445258cdc8b07dde95d70/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.774228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e72e4753a6444d1b6c9f4ab90239a4e, group_id=e55a38c213d445258cdc8b07dde95d70, role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:36.775732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:36.794651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:36.795542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:36.795831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:36.796111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:36.809232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:36.817375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:36.818350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:36.819156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:36.821598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 204/396] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:36.827741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:36.857810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 193/397] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jun 20 12:08:36 2022] PUT /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e/groups/e55a38c213d445258cdc8b07dde95d70/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:08:36.959491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:36.983830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995a030-cda2-4df2-81be-ca4d79140ab2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:37.033627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:37.034589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.035023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.035449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.036373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:37.036992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:37.039022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:37.049417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 205/398] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:37.054881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:37.076451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:37.171117 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa0fa1-02d5-4c86-9a7a-d44eadaf58c9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:37.206464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:37.207326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.207612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.207892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.209086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:37.210607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:37.213135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 194/399] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:37 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:37.218580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:37.376919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d111cd-e6ad-4960-9158-6cd02afa019f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:37.420523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89adcff-638b-4e78-b459-2df11e20c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:37.422077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89adcff-638b-4e78-b459-2df11e20c61d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.422510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89adcff-638b-4e78-b459-2df11e20c61d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.422934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89adcff-638b-4e78-b459-2df11e20c61d None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.424302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89adcff-638b-4e78-b459-2df11e20c61d None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:37.425902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89adcff-638b-4e78-b459-2df11e20c61d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:37.427771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 206/400] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:37 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:37.434231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:37.508342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0278-36ea-40e6-8f34-4afa0d31d913 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.508999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0278-36ea-40e6-8f34-4afa0d31d913 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.510061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0278-36ea-40e6-8f34-4afa0d31d913 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.511894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 207/401] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:37.516680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.517207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.517711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.531125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:37.549872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:37.550553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7d38e-6ce2-49cc-be0b-b2469244849c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:37.551284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:37.564292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:37.588593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3241a-6d51-436d-acc6-626f58b9a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:37.589803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3241a-6d51-436d-acc6-626f58b9a427 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.590274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3241a-6d51-436d-acc6-626f58b9a427 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.590711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3241a-6d51-436d-acc6-626f58b9a427 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112/groups/e55a38c213d445258cdc8b07dde95d70/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.593161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3241a-6d51-436d-acc6-626f58b9a427 None admin] RBAC: Authorizing `identity:create_grant(project_id=9060c5c191c541fa8daff8f02e043112, group_id=e55a38c213d445258cdc8b07dde95d70, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:37.595080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3241a-6d51-436d-acc6-626f58b9a427 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:37.649145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 208/402] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:37.672482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:37.705859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 195/403] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jun 20 12:08:37 2022] PUT /identity/v3/projects/9060c5c191c541fa8daff8f02e043112/groups/e55a38c213d445258cdc8b07dde95d70/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:37.736281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34648d-bf14-428f-b740-edeb6bf4c86d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.736626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34648d-bf14-428f-b740-edeb6bf4c86d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.737139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34648d-bf14-428f-b740-edeb6bf4c86d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.739162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 196/404] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:37.746218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.746525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.746788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.777575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:37.780114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:37.858327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78c8bb-a9aa-415e-a445-195ac50b66d2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:37.885875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 197/405] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:37.908152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:37.908988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:37.909239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:37.909520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:37.914942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:37.924680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:37.938742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:37.939669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:37.940478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 209/406] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:37.947811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:37.954292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.053120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.094706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994a08b-3e5b-4bcb-9cde-06b26066639c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.137643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.138687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.139113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.139530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.140239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b782b-36f2-455c-a6ed-9790200ffae1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.140704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:38.141183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.143565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.153294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 210/407] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:38.158758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:38.225336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.233445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.234292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.234574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.238364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.265072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287a79-a329-465a-88e5-7fb5fcc50fda None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.266868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:38.282558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:38.283458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:38.284932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 198/408] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:38.291901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:38.304146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.305089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.305377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.305658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.307473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.308959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.310967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 211/409] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:38 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:38.316347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:38.462102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eb172-b9f4-41e9-8289-5ee3138de918 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.482584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a787a6-48d2-45a0-ac38-ce57cd86e3b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.490349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.497662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.498367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.498707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.499005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.499771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:38.500360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.501897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.520659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 199/410] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:38.526626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:38.539205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.550205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.551078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.551365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.552898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.553977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.555469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.557753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 212/411] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:38 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:38.563677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:38.686079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8a82-359c-48a2-a86c-5a7ac6644aca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.734436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.735218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.735505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.735783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] PATH_INFO: `/v3/groups/fb266489fe2c47608a9bb7269e61ddc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.738502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af271b25-e469-4fbe-8027-b4ca5c8ece1d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.740715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] RBAC: Authorizing `identity:get_group(group_id=fb266489fe2c47608a9bb7269e61ddc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.742208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.744463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 200/412] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:38 2022] GET /identity/v3/groups/fb266489fe2c47608a9bb7269e61ddc8 => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:38.763957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:38.812269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.813162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.813450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.813733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112/groups/e55a38c213d445258cdc8b07dde95d70/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.818365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] RBAC: Authorizing `identity:create_grant(project_id=9060c5c191c541fa8daff8f02e043112, group_id=e55a38c213d445258cdc8b07dde95d70, role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.822207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.864458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.903782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddb97-dd3d-480b-b314-9b377fc79643 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:38.915018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 213/413] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jun 20 12:08:38 2022] PUT /identity/v3/projects/9060c5c191c541fa8daff8f02e043112/groups/e55a38c213d445258cdc8b07dde95d70/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:38.958825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3af9-1ee0-4ff6-b536-37d65743f5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:38.959877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3af9-1ee0-4ff6-b536-37d65743f5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:38.960215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3af9-1ee0-4ff6-b536-37d65743f5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:38.960503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3af9-1ee0-4ff6-b536-37d65743f5d1 None admin] PATH_INFO: `/v3/projects/5236866843c24c419599ba663dbbb1be` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:38.963326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3af9-1ee0-4ff6-b536-37d65743f5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=5236866843c24c419599ba663dbbb1be)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:38.964906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3af9-1ee0-4ff6-b536-37d65743f5d1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:38.967083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 201/414] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:38 2022] GET /identity/v3/projects/5236866843c24c419599ba663dbbb1be => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:38.972942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:39.056750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:39.130972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e6d40-1600-4dc3-a8ad-f5e9e2edab77 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:39.176982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13e11-08e3-40cc-8423-e0e3c2f4ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:39.177905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13e11-08e3-40cc-8423-e0e3c2f4ad0c None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.178229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13e11-08e3-40cc-8423-e0e3c2f4ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.178514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13e11-08e3-40cc-8423-e0e3c2f4ad0c None admin] PATH_INFO: `/v3/projects/5236866843c24c419599ba663dbbb1be/groups/fb266489fe2c47608a9bb7269e61ddc8/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.180766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13e11-08e3-40cc-8423-e0e3c2f4ad0c None admin] RBAC: Authorizing `identity:create_grant(project_id=5236866843c24c419599ba663dbbb1be, group_id=fb266489fe2c47608a9bb7269e61ddc8, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:39.182398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13e11-08e3-40cc-8423-e0e3c2f4ad0c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:39.185240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d41b5-dda6-45a4-8917-937e23de5f12 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.185525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d41b5-dda6-45a4-8917-937e23de5f12 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.185807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d41b5-dda6-45a4-8917-937e23de5f12 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.187685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 202/415] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:39.195245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.195625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.195974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.215732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:39.216923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:39.270788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 214/416] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jun 20 12:08:38 2022] PUT /identity/v3/projects/5236866843c24c419599ba663dbbb1be/groups/fb266489fe2c47608a9bb7269e61ddc8/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:39.272348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d7e5-3c49-4991-9189-52f4903e494d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.272748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d7e5-3c49-4991-9189-52f4903e494d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.273073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d7e5-3c49-4991-9189-52f4903e494d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.275518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 215/417] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:39.282036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.282458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.282835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.296693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 203/418] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:39.315344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:39.316542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:39.347579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:39.406449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 216/419] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:39.436231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:39.468721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:39.494746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:39.521856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489f882-ffae-4c22-bb74-5c48267b0cf0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:39.559643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:39.560449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.560733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.561012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.572167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:39.574823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a7f9-2ec8-47db-a9a7-3282f20c4523 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:39.587249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:39.588689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:39.589477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 204/420] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:39.594813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:39.662435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:39.665765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.666077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.666359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.691025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:39.707316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:39.708237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:39.709034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:39.711861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 217/421] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:39.718383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:39.757758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7098-6968-48cf-969e-d41b4f6ea986 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:39.779906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:39.801605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:39.802651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.803142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.803617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.804663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:39.805174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:39.807356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:39.824696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 205/422] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:39.834379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:39.908185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf617-30e6-4a3a-bf1a-e6dd33bbd219 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:39.929510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:39.953915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676905b-5bb9-4b6e-bac4-ec949ac028db None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:39.994179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:39.995125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:39.996041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.996523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.997379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:39.997855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:39.998409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:39.998696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.006016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:40.006016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.006016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.013873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 218/423] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:40.015249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.086448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.117906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.121119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.196017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debfd06-54fe-4c66-a700-2143f905c988 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.229252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 206/424] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:40.238024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338958d-a732-4b10-a05e-0579b0b4d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.238024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338958d-a732-4b10-a05e-0579b0b4d04a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.238024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338958d-a732-4b10-a05e-0579b0b4d04a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.238024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338958d-a732-4b10-a05e-0579b0b4d04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.239563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.310351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.347866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338958d-a732-4b10-a05e-0579b0b4d04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.349300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338958d-a732-4b10-a05e-0579b0b4d04a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.394476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.414671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91dc28-db2c-443a-a86c-2dd282a41313 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.457641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 219/425] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:40.459303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439d8b-ab0e-4bfb-9c2b-00e8fdeb4a04 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.459738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439d8b-ab0e-4bfb-9c2b-00e8fdeb4a04 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.460185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439d8b-ab0e-4bfb-9c2b-00e8fdeb4a04 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.461643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 220/426] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:40.464640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7920af4-0da3-4adc-a7ec-c893d470bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.465726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920af4-0da3-4adc-a7ec-c893d470bf7b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.466213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920af4-0da3-4adc-a7ec-c893d470bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.466914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920af4-0da3-4adc-a7ec-c893d470bf7b None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.468326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28439d8b-ab0e-4bfb-9c2b-00e8fdeb4a04 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.468461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7920af4-0da3-4adc-a7ec-c893d470bf7b None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.469722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7920af4-0da3-4adc-a7ec-c893d470bf7b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.471923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 207/427] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:40.474278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.474712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.475150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.496576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:40.498610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:40.556114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.580929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 208/428] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:40.587829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.592752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28439d8b-ab0e-4bfb-9c2b-00e8fdeb4a04 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.631965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.632755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.633037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.633312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] PATH_INFO: `/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.635007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] RBAC: Authorizing `identity:get_project(project_id=7e72e4753a6444d1b6c9f4ab90239a4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.636717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.643363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 221/429] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/projects/7e72e4753a6444d1b6c9f4ab90239a4e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:40.644321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.695130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.716118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc797b6-5338-4093-8063-2117cba3dca5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.744884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f1f1-7e82-40ff-a0ed-190775a13e37 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.757893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.759720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.760207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.760709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.762264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.767300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.769599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 209/430] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:40.778810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.779644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.780582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.780894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.781232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.791703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.792808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:40.801005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:40.805041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 222/431] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:40.805846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.923315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780e88-378f-49a5-bfa0-8ac4b0201d31 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.925575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c614804-75aa-4a3c-ac6e-ca2ffab2d967 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:40.961574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.961853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:40.962977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.963209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:40.963391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.963599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:40.963738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.963865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:40.964726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:40.964955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.965154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:40.966463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.966745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:40.968397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 210/432] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:40.969184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.978420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 223/433] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:40.979510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:40.996505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.049527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.091870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc257-29bc-4b38-9465-92ec02773d94 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.141004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.141793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.142198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.142545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.143546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:41.143926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:41.145457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:41.154867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5deb-93e8-431a-9726-f047e874e35c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.158269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 224/434] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=7e72e4753a6444d1b6c9f4ab90239a4e&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:41.217641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.218286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.218575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.218855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.219706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:41.220021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:41.221507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3e3b-dd98-4374-bdc2-7d63dd4d5b70 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:41.237297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:41.238400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 211/435] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:08:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:41.391956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9ed48-824e-408b-aa09-ac0413252d32 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.418580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9613-e81e-4444-ba73-d9d77e754470 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.419225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9613-e81e-4444-ba73-d9d77e754470 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.419701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9613-e81e-4444-ba73-d9d77e754470 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.421555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 212/436] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:41.422729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.432653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.439373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37020-c1a2-4153-b1c2-af24897ee767 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.439373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37020-c1a2-4153-b1c2-af24897ee767 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.439373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37020-c1a2-4153-b1c2-af24897ee767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.439625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.439625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.439625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.455975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c2f37020-c1a2-4153-b1c2-af24897ee767 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:41.457411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c2f37020-c1a2-4153-b1c2-af24897ee767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:41.515661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:41.517709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:41.539500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 213/437] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:41.543268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdfed1-0bc0-4f35-8268-5a7888195a19 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.543268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdfed1-0bc0-4f35-8268-5a7888195a19 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.543268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdfed1-0bc0-4f35-8268-5a7888195a19 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.544618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 214/438] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:41.550665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.550945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.551397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.570679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:41.571991 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:41.574092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.634414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 225/439] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:41.634905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:41.653434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 215/440] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:41.654679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:41.673977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.759597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f88e1-c2be-44d8-bf16-df5289c22982 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.777974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65979b-607d-4fb4-9dac-a01ddd18245e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.798144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.799268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.799550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.799830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.811218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:41.820505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:41.820687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:41.821551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:41.822423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:41.823022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.823022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.823022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.823198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 226/441] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:41.823198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:41.823335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:41.824188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:41.828979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 216/442] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:41.830248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:41.840093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.912338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:41.924852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281fa69-21a0-4083-ba28-100865635ad1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.928629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f50f4-a544-475f-b1ce-986cbea70171 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:41.957652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.958471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.958759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.959039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.961647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:41.962689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:41.962980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:41.963257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:41.964086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:41.964394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:41.965762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:41.969522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:41.973710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 217/443] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:41.974519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:41.977153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:41.979981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 227/444] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:41.980787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.042188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.074390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c5c4-fecf-4001-b66a-fc3340066344 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.076297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593279b-de9e-4172-9342-a9dd72bff0cc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.108530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.109382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.109677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.109956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.110675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.111180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.111337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.111611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.111890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.112623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.119141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 218/445] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:42.119141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.131337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.182166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.183736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.213129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a7647-5b9b-4314-af10-4da19b54b062 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.250222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.250883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.251165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.251442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.252185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:42.252490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.253860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.256058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.262892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 219/446] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:42.263952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.287930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 228/447] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:42.289022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.336239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.365841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d4eb-a4cc-480a-b7e7-132dbb636d98 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.386016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977ca11-5b75-46a2-803b-cb2ccb59eb52 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.401410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.402093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.402382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.402663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.403491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=5deb6d93e9c34f3bbfcf82d23e06790e, scope.project.id=9060c5c191c541fa8daff8f02e043112) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:42.403807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.405264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.411153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 220/448] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=5deb6d93e9c34f3bbfcf82d23e06790e => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:42.411759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.435455 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.436133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.436420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.436701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.482929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.514679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.516338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.532053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514632d-4b6d-487e-9b6e-bd10be4699f1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.570579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.572827 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.573690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.573979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.574282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] PATH_INFO: `/v3/projects/9060c5c191c541fa8daff8f02e043112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.575499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] RBAC: Authorizing `identity:get_project(project_id=9060c5c191c541fa8daff8f02e043112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.576987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.582016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 221/449] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/projects/9060c5c191c541fa8daff8f02e043112 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:42.584354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.632748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 229/450] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:42.640074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.709735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c5755-05d7-4898-8723-9c29397dc74f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.744363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.752032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.756493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.756493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.756493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] PATH_INFO: `/v3/groups/e55a38c213d445258cdc8b07dde95d70` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.756493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] RBAC: Authorizing `identity:get_group(group_id=e55a38c213d445258cdc8b07dde95d70)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.756493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.758939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 222/451] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/groups/e55a38c213d445258cdc8b07dde95d70 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:42.761135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa232a-437b-45aa-9214-baa94f202c9f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.764939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.797076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.797975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.798303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.798587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] PATH_INFO: `/v3/projects/5236866843c24c419599ba663dbbb1be` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.799773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] RBAC: Authorizing `identity:get_project(project_id=5236866843c24c419599ba663dbbb1be)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.801235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.802968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 230/452] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/projects/5236866843c24c419599ba663dbbb1be => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:42.808795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:42.827113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:42.864520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c2e3b-3bcf-4eaf-8469-a4ad945be3f3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.898185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.898834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.899121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.899404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.900230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] RBAC: Adding query filter params (group.id=e55a38c213d445258cdc8b07dde95d70, role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=9060c5c191c541fa8daff8f02e043112) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:42.900545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.902028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.908067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 223/453] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/role_assignments?group.id=e55a38c213d445258cdc8b07dde95d70&scope.project.id=9060c5c191c541fa8daff8f02e043112&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:42.908614 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eb9d6-4cf3-4cf3-9265-502c9f4fcec8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:42.948755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd166b5-d78a-4033-b4f5-e2cdd4f7314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:42.949652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd166b5-d78a-4033-b4f5-e2cdd4f7314f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:42.949937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd166b5-d78a-4033-b4f5-e2cdd4f7314f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:42.950264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd166b5-d78a-4033-b4f5-e2cdd4f7314f None admin] PATH_INFO: `/v3/groups/fb266489fe2c47608a9bb7269e61ddc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:42.951560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd166b5-d78a-4033-b4f5-e2cdd4f7314f None admin] RBAC: Authorizing `identity:get_group(group_id=fb266489fe2c47608a9bb7269e61ddc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:42.953069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd166b5-d78a-4033-b4f5-e2cdd4f7314f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:42.954813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 231/454] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/groups/fb266489fe2c47608a9bb7269e61ddc8 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:42.960771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:43.024501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:43.065489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163d08b-02fb-419f-a62c-bce0edf1c7ef None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:43.098954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:43.099605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:43.099894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:43.100171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:43.101002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] RBAC: Adding query filter params (group.id=fb266489fe2c47608a9bb7269e61ddc8, role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=5236866843c24c419599ba663dbbb1be) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:43.101319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:43.103358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54cb62-89f0-4d8f-8860-10eddabc7037 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:43.110816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 224/455] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jun 20 12:08:42 2022] GET /identity/v3/role_assignments?group.id=fb266489fe2c47608a9bb7269e61ddc8&scope.project.id=5236866843c24c419599ba663dbbb1be&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:45.508799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f68dee-6acb-4acd-b9c9-947a1354f3d2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:45.509854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f68dee-6acb-4acd-b9c9-947a1354f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:45.509961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f68dee-6acb-4acd-b9c9-947a1354f3d2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:45.511620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 232/456] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:45.519114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85121-66cf-4061-9457-84ca8ca6b419 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:45.519114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85121-66cf-4061-9457-84ca8ca6b419 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:45.519114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85121-66cf-4061-9457-84ca8ca6b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:45.542585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9fa85121-66cf-4061-9457-84ca8ca6b419 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:45.543785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9fa85121-66cf-4061-9457-84ca8ca6b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:45.636451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 225/457] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:45.684695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f68dee-6acb-4acd-b9c9-947a1354f3d2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:45.802811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:45.832778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f68dee-6acb-4acd-b9c9-947a1354f3d2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:45.879354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac2b3-8b41-4b4c-98ec-5a2537b7ceed None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:45.879898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac2b3-8b41-4b4c-98ec-5a2537b7ceed None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:45.880315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac2b3-8b41-4b4c-98ec-5a2537b7ceed None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:45.882068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 226/458] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:45.884799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:45.885581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:45.885869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:45.886184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:45.890029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8d67-7fbe-401e-940a-35664ead542a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:45.890029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8d67-7fbe-401e-940a-35664ead542a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:45.890029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8d67-7fbe-401e-940a-35664ead542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:45.898097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:45.899615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-726f26ac-ed41-4f71-adfc-9762c95c1b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:45.920585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:45.921599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:45.922470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:45.922470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:45.922470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:45.922470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:45.922470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 233/459] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:45.928973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835c19-075f-4054-b8d9-a0a05888a8d1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:45.929273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835c19-075f-4054-b8d9-a0a05888a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:45.929564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf835c19-075f-4054-b8d9-a0a05888a8d1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:45.931665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 234/460] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:45.932426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf835c19-075f-4054-b8d9-a0a05888a8d1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:45.932690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-492d8d67-7fbe-401e-940a-35664ead542a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:45.934256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-492d8d67-7fbe-401e-940a-35664ead542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:46.006649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:46.030709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 227/461] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:46.033070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.033563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.034073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.064489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:46.065608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:46.067262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf835c19-075f-4054-b8d9-a0a05888a8d1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.117375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.119141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.120171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.120658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.121574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:46.122083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.124467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.128281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:46.138073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 228/462] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:46.139487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.142039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 235/463] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:46.147038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.267788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524992f-1421-43bd-8b52-f025a4ce96e0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.294922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772e7af-f7cd-4db1-921b-71051ff26caa None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.302965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc94b7-dfe2-40b8-b60d-9e7a1501f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.303645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc94b7-dfe2-40b8-b60d-9e7a1501f32e None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.303934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc94b7-dfe2-40b8-b60d-9e7a1501f32e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.304220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc94b7-dfe2-40b8-b60d-9e7a1501f32e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.304931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc94b7-dfe2-40b8-b60d-9e7a1501f32e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.306974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc94b7-dfe2-40b8-b60d-9e7a1501f32e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.314798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:46.332909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.338713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.338713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.338713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.344358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.345817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:46.363908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:46.364789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:46.365610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:46.365610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:46.365610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:46.365610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:46.365610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 229/464] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:46.365873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.454016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 236/465] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:46 2022] POST /identity/v3/users => generated 246 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:46.455349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cc904-7844-447a-ae0d-503de1e6f5b8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.455657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cc904-7844-447a-ae0d-503de1e6f5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.455923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cc904-7844-447a-ae0d-503de1e6f5b8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.461730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 237/466] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:46.461730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cc904-7844-447a-ae0d-503de1e6f5b8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.481234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17e43-d9bf-4e48-9c66-4e982fdefd09 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.529834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.531455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.531888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.532312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.542896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:46.546880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.548820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5b029caf-a9e3-4c7c-bf8b-694aef3f15b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:46.568719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:46.569618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:46.570911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:46.570911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:46.570911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:46.570911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:46.577747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 230/467] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:46.580489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.581005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.581486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.600597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:46.602434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:46.604640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cc904-7844-447a-ae0d-503de1e6f5b8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.620296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:46.648310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.649073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.649426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.650280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.651016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:46.651328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.652934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.666698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 238/468] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:46.667597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.692855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 231/469] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:46.693285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.801984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452194aa-281d-473c-b1e4-41c62b673add None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.814959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10267d8-acad-4c25-8a18-6b4580e7f347 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:46.820810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:46.850479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.851685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.852152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.852781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.854259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:46.854611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.856015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.864534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:46.865469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:46.866863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:46.868181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:46.869147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:46.874040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 239/470] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:46.874040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.874263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:46.961860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 232/471] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:46 2022] POST /identity/v3/users => generated 248 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:46.964429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:46.986388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:47.013110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8bbe5-be50-477f-8adc-2a9f921cd410 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:47.097450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:47.101955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.105591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.105869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.128474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:47.128678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d450d-9610-43ca-8875-81d5be82d571 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:47.128762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:47.148468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:47.149382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:47.150290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:47.150290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:47.150290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:47.150290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:47.150290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 240/472] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:47.157037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:47.177426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd249f-99b4-4598-a8ee-c878fd805b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:47.178193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd249f-99b4-4598-a8ee-c878fd805b57 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.178481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd249f-99b4-4598-a8ee-c878fd805b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.178763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd249f-99b4-4598-a8ee-c878fd805b57 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.179539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd249f-99b4-4598-a8ee-c878fd805b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:47.181564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd249f-99b4-4598-a8ee-c878fd805b57 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:47.195618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:47.274085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d12a8-546b-40d7-8994-2dafe12e0d93 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:47.298414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 233/473] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:46 2022] POST /identity/v3/users => generated 248 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:47.301515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038eb1-5fbd-47d7-9143-a3f1e65c81fe None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.302134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038eb1-5fbd-47d7-9143-a3f1e65c81fe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.302593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038eb1-5fbd-47d7-9143-a3f1e65c81fe None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.310808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 234/474] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:47.316945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.317548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.318016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.318399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:47.319079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.319365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.319642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.325336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:47.325336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:47.325336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:47.338972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 241/475] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:47.349263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:47.357350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:47.363563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:47.483297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:47.510214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:47.519603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 235/476] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:47.536187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1aed3-e7a2-4286-b066-f0d33e99f9e1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:47.550189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:47.575548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:47.576237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.576532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.576824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.577545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:47.579042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:47.662539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5174c-9d4a-4817-ab56-38fcf4d293db None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:47.698964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:47.699642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.699929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.700210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.700966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:47.702487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:47.726298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 242/477] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:47 2022] POST /identity/v3/users => generated 249 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:08:47.767957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 12:08:47.767957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 12:08:47.767957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [parameters: {'id': '5562ac4926c44ec9880957c36f8f5c9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 12:08:47.767957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 20 12:08:47.790569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:08:47.791516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 12:08:47.792883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:08:47.793726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:08:47.794634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:08:47.795458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'id': '5562ac4926c44ec9880957c36f8f5c9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:47.796275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 12:08:47.797069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:47.797886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 236/478] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jun 20 12:08:47 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:47.805149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:47.927790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fa966-c713-44a0-ba8e-ece57e8b358f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:47.966817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaf175-6684-483c-9a67-fd53be569af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:47.967638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaf175-6684-483c-9a67-fd53be569af8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:47.967927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaf175-6684-483c-9a67-fd53be569af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:47.968276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaf175-6684-483c-9a67-fd53be569af8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:47.976579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:47.980689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eaf175-6684-483c-9a67-fd53be569af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-95eaf175-6684-483c-9a67-fd53be569af8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:47.989122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:47.994266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:47.995077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 243/479] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:08:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:47.996937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:48.094996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:48.141515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82d7d5-25d4-4e14-babc-64f581549557 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:48.178596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:48.179189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:48.179475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:48.179758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:48.180516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:48.181359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:48.182828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b75aa5-4143-4047-b2f2-7ccdb45d37bd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:48.192872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 237/480] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:48.863721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1b302-1727-48b5-b258-2ae146cec8da None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:48.864248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1b302-1727-48b5-b258-2ae146cec8da None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:48.864468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1b302-1727-48b5-b258-2ae146cec8da None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:48.866380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 244/481] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:48.871418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:48.872258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:48.872741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:48.894252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:48.895529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:48.977169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 238/482] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:49.030879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1b302-1727-48b5-b258-2ae146cec8da None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:49.178779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1b302-1727-48b5-b258-2ae146cec8da None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:49.228441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ae07b-31f7-4143-aa5e-be1a5b2bd5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:49.229244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ae07b-31f7-4143-aa5e-be1a5b2bd5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.229533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ae07b-31f7-4143-aa5e-be1a5b2bd5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.229815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ae07b-31f7-4143-aa5e-be1a5b2bd5e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.252822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ae07b-31f7-4143-aa5e-be1a5b2bd5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5f4ae07b-31f7-4143-aa5e-be1a5b2bd5e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:49.260048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:49.261494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:49.264244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 245/483] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:49.272472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:49.353637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181d4f4-1b03-413a-859a-4a3c0cf2e729 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.353962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181d4f4-1b03-413a-859a-4a3c0cf2e729 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.354224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181d4f4-1b03-413a-859a-4a3c0cf2e729 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.355588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 246/484] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:08:49.360321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.360613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.360892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.366691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:49.402171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:49.403399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:49.467801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85d682-f151-43eb-adf7-73e3a3001870 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:49.519042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:49.519972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.520795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.521141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.521898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:49.522300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:49.523691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:49.532650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 239/485] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:49.539526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:49.555085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:49.574480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 247/486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:49.620007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:49.719039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b86f9-8262-4f20-8c3e-3bf417793059 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:49.740856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:49.775313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:49.776379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.776659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.776938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.790023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:49.792561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-be175e0b-301f-4fe6-a6df-f1dbceb596ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:49.812449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:49.813496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:49.814611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:49.814611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:49.814611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:49.814611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:49.817357 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 240/487] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:49.818157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15910adc-0c94-453d-b9f5-3daff8cdc1dd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.818442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15910adc-0c94-453d-b9f5-3daff8cdc1dd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.818716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15910adc-0c94-453d-b9f5-3daff8cdc1dd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.820209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 241/488] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:49.820818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dad46-34b9-43c6-9bb3-ef36a038c522 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:49.828669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.828669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.828669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.849149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:49.850851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:49.860542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:49.861428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:49.861788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:49.862182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:49.873742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:49.881532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:49.882707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:49.883701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:49.885068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 248/489] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:49.886171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:49.942788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:49.961456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 242/490] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:49.961456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.018361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e42a-7899-4d43-a223-1ccac453dd38 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.063405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.064878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.065172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.065454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.066299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:50.066615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.068091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.086084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 249/491] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:50.087809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.094037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.109768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cefbb-5051-46f5-83b2-d98dd5ce5209 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.155155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.155836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.156122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.156543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.157440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:50.157748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.159902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.174065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 243/492] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:50.175312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.222136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0fbc-2ed8-48e5-ab83-040af38a2efb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.234658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.259876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.260912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.261094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.261369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.273543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:50.280621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf3cc-2bb4-47a3-8b30-de673d6ce3ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:50.282590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:50.283480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:50.284358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:50.288927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 250/493] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:50.289835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.320146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.321291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.321823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.322330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.330258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.331914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:50.349776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:50.350805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:50.351700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 244/494] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:50.353637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.368604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.402288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2232-5c72-4e3f-b43e-3ce86ced5bed None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.438993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.440036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.440535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.440815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.452960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.454476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.455130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16f70-9b3f-4002-a37e-42d8c54fa4ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b3119563-c8ba-4e13-86b9-214363a55b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:50.472342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:50.473259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:50.474141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:50.474141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:50.474141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:50.474141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:50.478309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 251/495] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:50.479607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bfa39-4d60-40aa-8f88-d8261d11b572 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.479900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bfa39-4d60-40aa-8f88-d8261d11b572 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.480262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bfa39-4d60-40aa-8f88-d8261d11b572 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.481707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 252/496] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:50.482244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bfa39-4d60-40aa-8f88-d8261d11b572 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.495717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.496739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.497229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.498189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.499540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:50.500342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.502245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.516833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 245/497] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:50.516833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.517398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.602347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.619304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bfa39-4d60-40aa-8f88-d8261d11b572 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.632505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a6303-2aee-41e4-a04c-e6a3f7571f05 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.657233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.657906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.658224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.658510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.659352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:50.659671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.661120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.670900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.671561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.671844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.672118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.673832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:50.674190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.675591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24c0b5-c792-434b-b667-8a0b791e5d31 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.698704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 246/498] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:50.698704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.698704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.698704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.707707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 253/499] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:50.707707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.719833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:50.721028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:50.790384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.795612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 247/500] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:50.796705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.814154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1608c-031d-48da-8769-38c75d31e6c4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.850344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.851142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.851428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.851704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.861626 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.863126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.877698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:50.881234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:50.882601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:50.883629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:50.883629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:50.883629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:50.883629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:50.883629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 254/501] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:50.883629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.929876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9972a2-8981-4dd6-a99c-0da188a60a10 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:50.966404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:50.967144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:50.967443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:50.967723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:50.975482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:50.976923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:50.991625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:50.992552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 248/502] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:50.994842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:50.995656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5dcb3-880c-4950-91ce-700bd6770eec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.029893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.035444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a3b75-f4be-4c26-9463-aa2102f32baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.036101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a3b75-f4be-4c26-9463-aa2102f32baa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.036376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a3b75-f4be-4c26-9463-aa2102f32baa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.036655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a3b75-f4be-4c26-9463-aa2102f32baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.099478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa0227-7d3b-4365-b604-b69c2f5cf733 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.106792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a3b75-f4be-4c26-9463-aa2102f32baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.108764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a3b75-f4be-4c26-9463-aa2102f32baa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.125823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.135010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.135800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.136079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.136351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.146300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:51.153911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:51.154907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 249/503] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:51.156006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.214696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 255/504] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:51.216010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2116-64f7-4083-a8e3-fb3b5370fc89 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.216297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2116-64f7-4083-a8e3-fb3b5370fc89 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.216648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2116-64f7-4083-a8e3-fb3b5370fc89 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.217841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 256/505] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:51.218563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2116-64f7-4083-a8e3-fb3b5370fc89 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.250067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.256674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e7fe-2eab-46f2-8f31-28a82fbab146 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.288847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.289493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.289773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.290076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.291306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:51.291612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.292994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.304221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 250/506] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:51.304992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.319705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2116-64f7-4083-a8e3-fb3b5370fc89 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.351596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.353547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.354383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.354902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.356303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.357143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:51.357456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.358922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.376131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 257/507] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:51.376131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.404862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee95580-8130-4ae0-8c6b-929a2d48368e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.439234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.439892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.440178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.440466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.441209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:51.441516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.442939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3827e-df5e-4efb-a739-f6fe0d4cdc51 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.450755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 251/508] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:51.451932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.452215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.452490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.468204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:51.469115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.469365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:51.479091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225fe78-515e-4b59-a8b0-bae9d444049f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.514853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.515644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.515928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.516200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.526148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.527585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.535738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 252/509] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:51.536642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:51.550877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:51.551884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:51.552942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:51.552942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:51.552942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:51.552942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:51.554465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 258/510] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:51.559738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.577394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.636364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff7c77-5ec0-4386-86a0-f69a0097a6fc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.657368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39212aa2-5cc9-426f-8c86-96c14fcad7ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.672624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.673421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.673709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.673988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.681151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.682644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.691948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.692595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.692878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.693154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:51.696853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:51.697750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:51.698721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 253/511] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:51.699289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.707144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.762625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.764034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.792699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.796131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1988-e20b-4283-8914-01293f66dee2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.828265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:51.829032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:51.829309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:51.829578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:51.840246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:51.841706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:51.859468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:51.860512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:51.861419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:51.861419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:51.861419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:51.861419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:51.861419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 254/512] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:51.861690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.866303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 259/513] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:51.867249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:51.910583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:51.968647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc34d1-eebc-4559-bac8-dcde4ab52898 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:51.971193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ca302-40ad-42ee-a262-bc3535698bb1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.002690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.003345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.003621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.003892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.004088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.004605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.004873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.004960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.005158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.005432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.006316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.015888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.017278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.017657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 255/514] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.018427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.031739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:52.038603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:52.044677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:52.045508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:52.045508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:52.045508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:52.045508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:52.045508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 260/515] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:52.045508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.125338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200a9b-b7d4-427f-96ae-ed4a1104c822 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.133327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.139839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46b24-3d2b-4624-82b0-0b7a4491c7b8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.157931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.158617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.158895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.159166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.159989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.160293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.161738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.174539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.175192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.175480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.175759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.176521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.176778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.178181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.189779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 261/516] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.190604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.198280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 256/517] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.199103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.263859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.293607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4540e-8ac8-4692-9fbf-d9363a61f988 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.296653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b392ca7-c0a7-44ec-bd16-1c7366b9c355 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.332220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.333006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.333290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.333564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.336147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.337436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.337727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.338014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.344523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.344822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.345967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.346309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:08:52.361695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:52.362563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:52.363410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 257/518] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:52.363881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:52.364627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:52.365472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:52.365472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:52.365472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:52.365472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:52.365694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.365760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 262/519] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:52.365760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.376130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.464130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34e0c-12a8-40e0-82ec-c593a068124b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.465071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca660eb-01b5-4735-b8a5-36fc4c8906cb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.490788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.497070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.497856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.498165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.498448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.506442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.506442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.506442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.506442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.506776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.506776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.506776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.507116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.507298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.513680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 258/520] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.514506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:52.522518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:52.523582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 263/521] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:52.525558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.590083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.615884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f1ab-5f75-4a86-8070-c7e11131d279 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.624230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875de0b-eef4-4fcd-846c-309d2b285257 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.649317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.650534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.650816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.651083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.657243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.657892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.658202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.658476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.659250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.659555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.661020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.679187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 264/522] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.679806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.711015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.721303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.722814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.780254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd14af-9016-4a53-a606-08695ef9c3f1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.805654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.814209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.814865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.815148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.815425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.816144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.821179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.821179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.821378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 259/523] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:52.821641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.833039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 265/524] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.833039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:52.906852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:52.919695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5729d9-4b19-4487-b526-1e26c314ffc8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.929509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328c33-e19b-418a-a490-5605a41ef900 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:52.953458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.954143 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.954424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.954701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.955431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.956871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.962935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:52.963609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:52.963899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:52.964188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:52.965025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:52.965363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:52.966831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:52.984067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 266/525] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:52.984854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.031866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.033326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 260/526] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:08:52 2022] POST /identity/v3/users => generated 247 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:08:53.033982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.097054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092e4a-1954-45de-ab78-1f6a3fee54d3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.144471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.145138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.145421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.145694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.146598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=99f73e12101d42c9b94d8b19ec555055) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:53.146910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.148496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.155228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 267/527] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:52 2022] GET /identity/v3/role_assignments?user.id=99f73e12101d42c9b94d8b19ec555055&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:53.155963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.170294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9caf6-adf3-463c-9b22-0e36d7766387 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.222084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.223235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.223705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.224178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.241231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.244137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.247501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:53.267387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:53.270643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:53.271482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:53.271482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:53.271482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:53.271482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:53.271482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 261/528] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:53.271482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.284271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60435966-86c8-4b9d-ae04-01182ebab2ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.296255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.330573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.331466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.331761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.332042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.343838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.345362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:08:53.359967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:53.360839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:53.362168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 268/529] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:53.362657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.409200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1092a-9a59-4209-85ab-a9870dd405c8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.455882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.456997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.457843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.458327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.476214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476270f-a435-4ef5-8371-d84a8b44a0d0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.516139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.516708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.517061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.517406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.518275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:53.518693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.520145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.537454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 269/530] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:53.538781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.539859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.550298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.552691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.569491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.646233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631ef23-820c-46d6-8b26-825ea4730eac None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.680239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 262/531] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:53.682120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.689025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.689736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.690134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.690353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.691153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:53.691458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.693337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.710239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 270/532] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:53.711397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.788929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.796379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ba99-663f-42f5-b874-29953ea50418 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.814349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:53.827244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55095f50-ab27-401b-a4aa-175c1c00c46e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:53.833704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.834744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.835212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.835652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.844353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.846178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:08:53.860832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:53.861663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:53.862537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:53.866153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 263/533] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:53.867334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.870508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:53.871307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:53.871591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:53.872662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:53.883536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:53.885038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:53.903525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:53.905448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:53.906565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:53.906565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:53.906565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:53.906565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:53.909430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 271/534] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:53.910406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:53.980637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134fcee-804a-4cef-bf77-3139f7d4b30b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.015090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de426a3-4d1d-4f30-8737-4209aa1c5bb1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.017506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.019033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.019824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.020607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.022503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=f2124f6539264fa3a4b0ec190e23b2d5) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:54.023328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.026697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.033556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 264/535] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/role_assignments?user.id=f2124f6539264fa3a4b0ec190e23b2d5&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:54.035157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:54.060841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:54.074868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.075670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.075959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.076240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.077046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:54.077356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.078901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.095171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:54.099795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 272/536] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:54.105682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:54.152501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ed46-c3a3-4034-b567-c14252afcc58 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.191081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.192105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.192613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.193087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.194048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:54.194559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.196336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.209497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 265/537] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:54.215233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:54.295652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a17b-eb5e-495d-98fd-eb55455bfce2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.359308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.359985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.360242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.360521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.361362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=f08d1a5b8e594901b986f1bde71e015a) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:54.361673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.363163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.365356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:54.370208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 273/538] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:54 2022] GET /identity/v3/role_assignments?user.id=f08d1a5b8e594901b986f1bde71e015a&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:54.389208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a487f0-b2f1-4c03-b9cf-23a469dd111d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.444617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.445431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.445718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.446018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.463416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.464949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:08:54.484210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:54.485130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:54.486641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 266/539] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:54.495045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:54.585981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:54.626231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155bf5-c483-406a-9858-6781414ae3af None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.661568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.662268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.662619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.662902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.664000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:54.664319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.666362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ef1d-63e1-429a-bb74-06aa0ffd54ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.689267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 274/540] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:54.694799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:54.808775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1598-bbf7-4444-9532-910f4a29ad3e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:54.870107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:54.870107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:54.870107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:54.870107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:54.870486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=0db4109ed2c6485eb033cb10eee8e67b) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:54.870486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:54.872012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60119ecf-43f6-4d6c-a458-f7ee265933a6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:54.882860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 267/541] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:54 2022] GET /identity/v3/role_assignments?user.id=0db4109ed2c6485eb033cb10eee8e67b&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:55.461091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8914ad8-b268-4838-a5b6-425eb82d3e65 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:55.461603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8914ad8-b268-4838-a5b6-425eb82d3e65 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:55.461678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8914ad8-b268-4838-a5b6-425eb82d3e65 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:55.464107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 275/542] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:55.469518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:55.470351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:55.470825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:55.480920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:55.494127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:55.495328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:55.516061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae795b-772b-4c2a-b470-c6d7586df669 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:55.516385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae795b-772b-4c2a-b470-c6d7586df669 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:55.516637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae795b-772b-4c2a-b470-c6d7586df669 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:55.518305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 276/543] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:55.524924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:55.525225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:55.525511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:55.561850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:55.563231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:55.583625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 268/544] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:55.619563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:55.682106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 277/545] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:08:55.699805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:55.789983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:55.799543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b279-783c-427b-818d-7845cd3e313b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:55.837659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:55.838605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:55.838888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:55.839162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:55.849006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:55.852256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:55.860304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:55.865683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:55.866553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 269/546] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:55.867856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:55.916238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278c89-10a7-4422-b32d-a92873be481b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:55.974069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ffcc5-0db5-469e-bca6-27dfa3aaf41e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.009437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.010143 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.010428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.010703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.011551 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:56.011861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.013246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.014688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.015491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.015784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.016067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.026178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 270/547] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:56.028060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.043358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:56.059217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:56.060109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:56.061321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 278/548] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:56.077397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.098389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:56.153374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a6013-7d99-47c0-8ca1-741c48f2ce52 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.219463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.220259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.220543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.220819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.240000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.241470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.251897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f816cf-88cc-494a-8b6c-e72fe0cc6de3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:56.273710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:56.274718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:56.275607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:56.275607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:56.275607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:56.275607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:56.281554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 271/549] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:56.284355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.285851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:56.331162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.331765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.332049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.332329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.333088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:56.333398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.334810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.348952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 279/550] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:56.350491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.506742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081fbf9-85a2-40a9-b6c2-70a23ad40378 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.510301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175502dc-7d84-46ca-9988-e8b8ec4938bb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.527706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:56.573248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.574068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.574356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.574631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.577266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.577928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.578233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.578508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.579229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:56.579536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.580927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.604665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.605051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 272/551] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:08:56.606405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.607062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:56.635230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:56.636175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:56.637040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:56.637040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:56.637040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:56.637040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:56.639406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 280/552] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:56.653127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.710374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:56.714582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3a08e-47de-4cff-8864-b604e3c57db4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.751857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.752657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.752942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.753218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.767185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.768782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9f1608c8-f7e9-40a3-a206-1b72ed78aff8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:56.800444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:56.801421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:08:56.802372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:56.802902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 273/553] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:08:56.804649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d53501-962a-468f-8bc0-3818bc666f11 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.805074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d53501-962a-468f-8bc0-3818bc666f11 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.805489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d53501-962a-468f-8bc0-3818bc666f11 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.808531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 274/554] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:56.809858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d53501-962a-468f-8bc0-3818bc666f11 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:56.829367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772956a-0c37-45cb-8232-aad822cf30a5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:56.847130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:56.874290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:56.874883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.875174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.875458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.876196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:56.876574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:56.878988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b319117-7c99-492b-a341-df9c4d0238c5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:56.895080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 281/555] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:56.896645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cf627-67e1-44ea-920f-435c52e140ee None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:56.897730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cf627-67e1-44ea-920f-435c52e140ee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:56.898036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cf627-67e1-44ea-920f-435c52e140ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:56.920521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a64cf627-67e1-44ea-920f-435c52e140ee None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:56.922230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a64cf627-67e1-44ea-920f-435c52e140ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:56.934703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d53501-962a-468f-8bc0-3818bc666f11 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.012547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.013220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.013505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.013788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.014654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:57.014965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.016419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.036473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 275/556] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jun 20 12:08:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:57.037977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.051889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 282/557] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:57.053465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f05f-0e9c-4657-a95f-2e2e7a8bb5ae None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.053969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f05f-0e9c-4657-a95f-2e2e7a8bb5ae None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.054462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f05f-0e9c-4657-a95f-2e2e7a8bb5ae None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.056205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 283/558] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:57.057065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3f05f-0e9c-4657-a95f-2e2e7a8bb5ae None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.080332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.161318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.177639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd72bd-3d09-4c35-9bbb-b24a8ddb0b29 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.183922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3f05f-0e9c-4657-a95f-2e2e7a8bb5ae None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.213857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.214682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.214973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.215255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.220655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.221496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.221928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.222390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.222595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.224062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-603900f9-ec19-4efd-8b1a-4f7d2d0f3ce6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:57.239005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:57.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 276/559] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:57.241445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.242663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.242663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.259630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:57.260826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:57.300013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.301456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.319649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.326780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 277/560] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:57.327491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.402510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 284/561] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:57.403610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.406603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.429248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5c91-060b-4dd2-bcdf-c72a824c9234 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.463089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df25d-2f64-4310-8aa4-a2c0f2ec146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.463877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df25d-2f64-4310-8aa4-a2c0f2ec146b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.464165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df25d-2f64-4310-8aa4-a2c0f2ec146b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.464445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df25d-2f64-4310-8aa4-a2c0f2ec146b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.474882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333df25d-2f64-4310-8aa4-a2c0f2ec146b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-333df25d-2f64-4310-8aa4-a2c0f2ec146b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:57.483031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:57.483957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:57.484881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 278/562] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:57.485575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8feb22-c254-4bab-a39a-4799b3d2bf36 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.485691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8feb22-c254-4bab-a39a-4799b3d2bf36 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.485972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8feb22-c254-4bab-a39a-4799b3d2bf36 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.487263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 279/563] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:08:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:08:57.488142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8feb22-c254-4bab-a39a-4799b3d2bf36 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.505572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618c28b-8392-47ce-b9b3-03c36a271783 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.522714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.539636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.540945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.541231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.541510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.542383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:57.542702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.544135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.561929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 285/564] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:57.562752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.590925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8feb22-c254-4bab-a39a-4799b3d2bf36 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.625000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.625791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.626108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.626392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.628970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.637100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:57.644636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:57.650342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 280/565] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:57.651202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.667015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729f03-3e40-4759-bb3b-0b7191e8f0d9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.700098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.700826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.701116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.701397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.711209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.713187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-34edbab2-3dac-488c-b4c7-6782574112d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:57.730821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:57.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:57.732589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:57.732589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:57.732589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:57.732589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:57.732589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 286/566] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:57.733162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.733440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.733721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.745709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377c47-a0e8-4871-bc25-cb91c3e7f840 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.749342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:08:57.750594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:08:57.772205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.779010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.785884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.785884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.785884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.785884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:57.785884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.785884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.791251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 281/567] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:57.792033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.815268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 287/568] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:57.816099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.850434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:57.892990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b40f6-d87e-480d-a475-f18ddb19bbae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.924904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979b683-91ec-46de-b7a7-b27673b66fb5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:57.927290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.928070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.928356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.928629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.939092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.940672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:57.958214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:57.959079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:57.959980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:57.959980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:57.959980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:57.959980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:57.959980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 282/569] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:57.960280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:57.960280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:57.960432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:57.960500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:57.960576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:57.961300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:57.961606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:57.963610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:57.971666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 288/570] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:57.972443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.004631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.081056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a958fe-beed-4e94-ab72-f7f7309fb7a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.081267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f366e-d0f6-4a58-b5f6-9d7192070d94 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.092074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.115271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.115534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.115811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.116088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.116392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.116808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:58.117115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.117204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.117444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.117721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.118566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.128546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.130023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.134385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 283/571] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:58.135432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:58.148252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:58.149377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:58.150898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:58.150898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:58.150898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:58.150898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:58.150898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 289/572] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:58.151184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.220251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.234641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cf1c-cd3f-418f-ae7b-9c975666701b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.250498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecc4c-8250-4574-979b-9f28f861a94a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.267491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.268268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.268547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.268821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.278506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:08:58.284053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.284706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.284994 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.285276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:08:58.285981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:58.287054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:08:58.287885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:58.288811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:58.288811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.288953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 284/573] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:58.289031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.289105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.300941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 290/574] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:58.301730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.325158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.392761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143791e0-943d-44c5-a499-1e94790d5180 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.398852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e2fc-1c29-473c-8f7d-e95cc05671b7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.426625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.427413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.427701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.427979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.433684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.437910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.438855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.439421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.439645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.439932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.440217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.446986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.448417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:58.456500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:58.457510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:58.458632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:58.458632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:58.458632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:58.458632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:58.458632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 285/575] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:58.458919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:08:58.462436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:58.463325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:58.464219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 291/576] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:58.464734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.543487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.560693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b0fdf-535b-477f-af71-536cfc921e85 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.561796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f117b3-b25f-4109-bd43-cc16e8a38e2b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.594310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.594774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.594958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.595242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.595341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.595519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.595611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.595801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.596241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:58.596547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.596643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:58.596856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.597914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.598240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.606841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 292/577] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:58.607627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.611835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 286/578] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:58.611835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.663774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.707108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302a25-44d0-402f-87b1-e2d1e01d6f04 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.708783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c412ab-6f8b-4ca9-889d-8f2a9096468c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.740532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.741324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.741666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.741882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.742280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.742934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.743248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.743526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.744242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:58.744554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.745938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.749104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.750618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.757432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 287/579] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:58.758247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.761370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:08:58.765183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:58.766328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 293/580] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:58.767237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.856860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246211ed-7f6c-456a-bf18-b1cfd9e0d21c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.868547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6c141-fd4e-4320-8fe9-a7769bd6b2a2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:58.881959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:58.890857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.891513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.896660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.896660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.896660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:58.896660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.896660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.903116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:58.903980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:58.904266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:58.904549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:58.912299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 288/581] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:58.913607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.915341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:58.916798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:58.934709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:58.938288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:58.939382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:58.939382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:58.939382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:58.939382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:58.939382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 294/582] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:58.939382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:58.977290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.015046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef059b-b7fd-49d1-9646-4054c0a6f129 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.040555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee56cc-991b-41c6-854a-c3e04b8992a3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.048625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.049414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.049699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.049980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] PATH_INFO: `/v3/users/glance` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.057301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.058843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:59.073147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:59.074322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:08:59.075279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:59.076083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.076172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 289/583] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:59.076255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.076255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.076255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.076438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.083049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.084478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:59.099238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:59.100348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:59.101313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 295/584] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:08:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:59.101912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.133594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.189016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d180de5-8971-4cb0-a19c-3977027c0aee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.211499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.212740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b8d37-b905-47cf-9de9-e79ad55ff00b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.224854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.225659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.225955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.226270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.227452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:59.227773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.229240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.245467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 290/585] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:59.245467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.248803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.249463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.249754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.250070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.250914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=1e132b21d8bb426391e00c48f22b9922) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:59.251232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.252658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.258207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 296/586] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/role_assignments?user.id=1e132b21d8bb426391e00c48f22b9922&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:59.259544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.358999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed2f4-87ea-460d-b75b-b1e8640a2917 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.377749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.387967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479ac4f-3ee8-4f82-adc2-213f70c677a0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.397263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.397940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.398263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.398546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.399366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:59.399686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.401162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.416046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 291/587] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:59.417309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.425547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.426312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.426595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.426872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.427713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:59.428029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.429460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.453847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 297/588] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:59.453847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.478257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.542605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999f269-46cc-4b96-aabd-057e547bffa8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.556953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7ce58-8900-43c9-bb70-74486c019c0b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.582306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.583177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.583817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.584448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.585491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:08:59.585867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.587963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.590767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.591662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.591943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.592219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/99f73e12101d42c9b94d8b19ec555055/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.607449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=99f73e12101d42c9b94d8b19ec555055, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.608903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.613704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 292/589] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:08:59.615159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.688830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.702038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 298/590] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:08:59 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/99f73e12101d42c9b94d8b19ec555055/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:08:59.702038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.728981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d6f57-9a15-47b1-b8a2-423524db0a5d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.766880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:59.781569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.783157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.783536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.784218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.794972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.797443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.809817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d57fa-5243-4f66-8bda-77b9bfcf205e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:08:59.822931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:59.824138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:08:59.825059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:08:59.825791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 293/591] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:59.826603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.858463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:08:59.859573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:08:59.859988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:08:59.860372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:08:59.872301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:08:59.873959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:08:59.897373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:08:59.898382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:08:59.899262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:08:59.899262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:08:59.899262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:08:59.899262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:08:59.899262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 299/592] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:08:59.900336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:08:59.953185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c084-51a4-4748-a51e-051d0b75e1b1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.001178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.021222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.022383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.022848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.023300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.035303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.037986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.057424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b8de4-14a0-4f1f-b63c-c63c030628e2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:00.058282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:00.059140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:00.060022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:00.060022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:00.060022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:00.060022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:00.062301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 294/593] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:00.063313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.085206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.108503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.109779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.115977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.115977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.116406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:00.116608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.121032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.152441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 300/594] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jun 20 12:08:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:00.153813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.212219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77d97-69fa-4456-8500-15abbfcf230a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.248841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.249629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.249988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.250356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.251183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:00.251565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.253144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.265766 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 295/595] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:00.266785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.292089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad359-b9f2-4084-8bea-c86b69b09bc3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.304140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.330940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.331784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.331928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.332165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.332893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:00.333202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.334636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.352138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 301/596] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:00.353728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.359240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.400879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d805f-3dfc-4379-b07a-4eb12a237102 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.445626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.446487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.446774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.447051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.460419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.461945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:00.480206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:00.481134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:00.482636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:00.482636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:00.482636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:00.482636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:00.482636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 296/597] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:00.482636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.489430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f752a2b-07a8-4d13-87fa-5a88d0f312f5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.525162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21750172-221d-4440-889d-579ef9236677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.526347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21750172-221d-4440-889d-579ef9236677 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.526856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21750172-221d-4440-889d-579ef9236677 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.527370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21750172-221d-4440-889d-579ef9236677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.534534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21750172-221d-4440-889d-579ef9236677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.536268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21750172-221d-4440-889d-579ef9236677 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-21750172-221d-4440-889d-579ef9236677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:00.551418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:00.552353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:00.553313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:00.555410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 302/598] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:00.557058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21750172-221d-4440-889d-579ef9236677 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.585831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.591838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4845910-4bd1-4215-a35c-b1ade1c1a7bd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.618875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.627198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.627945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.628228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.628506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.636539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.638057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:00.654577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:00.655483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:00.656370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 297/599] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:00.656847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.672110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21750172-221d-4440-889d-579ef9236677 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.709097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.710041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.710501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.710943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.711928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:00.712416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.714248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.730859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 303/600] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:00.731937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.766108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751b89-e4ff-4a09-abb4-1024efadefe8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.801351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.802191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.802908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.803137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.804076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:00.804494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.806615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.819051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 298/601] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:00.825130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.827973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.840953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c262a-5a9c-4135-b60d-707f551cb0c7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.877464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:00.878384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.879842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.880269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.880725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.881677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:00.882152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.884403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:00.902020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 304/602] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:00.903138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:00.938814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19d5a-b6a6-4448-a351-a0df86cfcd77 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:00.976509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:00.978167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:00.978517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:00.978884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:00.986370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:00.987918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:01.003031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:01.003975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:01.005252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:01.009073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 299/603] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:01.009813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:01.018505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3f933-8e99-4ba4-8253-29015f979248 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:01.056806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:01.058171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.058752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.059222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/f2124f6539264fa3a4b0ec190e23b2d5/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.076075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=f2124f6539264fa3a4b0ec190e23b2d5, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:01.077898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:01.120753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221051-eba6-4c38-844a-846e744c77b7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:01.124071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:01.160187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:01.171965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034f55-5f42-46fa-a7a7-81ae837a2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:01.173451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f55-5f42-46fa-a7a7-81ae837a2c2f None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.174186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f55-5f42-46fa-a7a7-81ae837a2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.174308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 305/604] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:00 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/f2124f6539264fa3a4b0ec190e23b2d5/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:09:01.174718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f55-5f42-46fa-a7a7-81ae837a2c2f None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/f08d1a5b8e594901b986f1bde71e015a/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.175525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:01.197586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab034f55-5f42-46fa-a7a7-81ae837a2c2f None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=f08d1a5b8e594901b986f1bde71e015a, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:01.200092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab034f55-5f42-46fa-a7a7-81ae837a2c2f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:01.327773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45559d-12a5-44c9-be60-9374e6cbfe14 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:01.352020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 300/605] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:01 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/f08d1a5b8e594901b986f1bde71e015a/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:09:01.370102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:01.370835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.371129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.371409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.372317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:01.372643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:01.374119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:01.374517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb377dd-75df-4065-8853-bb9434215ab5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.374810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb377dd-75df-4065-8853-bb9434215ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.375114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb377dd-75df-4065-8853-bb9434215ab5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.376718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 301/606] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:01.383804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.384081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.384368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.391092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 306/607] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:01.401739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:01.411671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:01.414081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:01.511356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 302/608] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:09:01.515540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:01.534542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:01.544299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901163-98c0-4137-94d5-7badcb622047 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:01.580656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec9d50-f5ae-4ff4-bc8a-28bf0306e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:01.581589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec9d50-f5ae-4ff4-bc8a-28bf0306e1ba None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.581953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec9d50-f5ae-4ff4-bc8a-28bf0306e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.582341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec9d50-f5ae-4ff4-bc8a-28bf0306e1ba None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/0db4109ed2c6485eb033cb10eee8e67b/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.602439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec9d50-f5ae-4ff4-bc8a-28bf0306e1ba None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=0db4109ed2c6485eb033cb10eee8e67b, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:01.605211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec9d50-f5ae-4ff4-bc8a-28bf0306e1ba None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:01.628617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:01.645534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb041-f825-42a9-af16-d279a9a42e5e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:01.683739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:01.684924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.685211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.685487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.696630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:01.704501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:01.712597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 303/609] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:01.713433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:01.721826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 307/610] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:01 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/0db4109ed2c6485eb033cb10eee8e67b/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:09:01.843250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c66-84fa-4b81-9512-d3623747e570 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.843680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c66-84fa-4b81-9512-d3623747e570 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.844076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c66-84fa-4b81-9512-d3623747e570 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.845935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 308/611] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:01.854549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.855091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.855495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.865253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a35b9-a40f-4d98-b70e-ab0b546f3416 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:01.887198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:01.888693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:01.904718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:01.905841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:01.906329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:01.906787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:01.907740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:01.908309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:01.910778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:01.921559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 304/612] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:01.926952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:01.941888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:01.992783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 309/613] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:02.021276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.063065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:02.075441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795396a2-580f-40ad-8929-a69bc1839f1d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.129954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.130890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.131193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.131472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.138886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc477cd-521a-4650-aff8-d9218238052f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.145946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:02.147876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:02.169001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:02.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:02.170849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:02.170849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:02.170849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:02.170849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:02.173288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 305/614] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:02.178270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.186751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.187613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.187903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.188182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.211898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:02.221619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:02.222587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:02.223430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:02.230258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 310/615] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:02.232226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.336700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:02.341456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978997-1387-4871-a22b-9c9a0c60e13f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.343665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:02.378064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.378882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.379300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.379737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.380664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:02.381080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:02.382618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:02.396762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 311/616] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:02.397981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.420817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6a37-609d-4c16-a2b0-80e834f60b45 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.469079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.470160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.470654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.471135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.472106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:02.472656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:02.474304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:02.496024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 306/617] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:02.501079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.518920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae94b5-5b67-44a1-a070-0d97c24485e7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.554950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.556372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.556620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.556903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.567919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:02.569382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:02.592570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:02.593541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:02.594633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:02.594633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:02.594633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:02.594633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:02.594633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 312/618] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:02.601676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.620735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:02.690038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c51e-1215-4889-aea2-4f5bfd68cc16 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.711357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f1cd-df73-44b8-a856-c98c88719424 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:02.725809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:02.756433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.757113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.757480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.757767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.758541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:02.758885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:02.760272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:02.763797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:02.764594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:02.764883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:02.765159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:02.778799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:02.780250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:02.785808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 313/619] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:02.793445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:02.815975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:02.816931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:02.817916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:02.819091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 307/620] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:02.824432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:02.937787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:02.993876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc71d-4450-4cad-8f3c-2af7c2851653 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.012146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70aef9-ab8f-4148-8cb5-dad4b6fba61a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.053163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.053840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.054149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.054426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.055264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:03.055611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.057060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.083721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.084519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.084798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.085073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.095505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 308/621] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:03.096552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.098020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.106146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:03.137063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:03.138142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:03.139091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:03.139637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 314/622] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:09:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:03.146644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:03.182362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:03.300151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e40f1-bf37-459b-b08f-84be9c2b09ff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.335568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.336247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.336532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.337360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.338221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:03.338534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.340376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.351950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a31d-aafe-4afc-b863-50a94c07032b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.354732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:03.358659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 315/623] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:03.364679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:03.468596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d5840-a44e-4693-8999-14b229c0600a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.486868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.487658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.487938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.488213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.507983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.509984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.528373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d25f5-b892-46ce-af2d-03b8cf695830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.529034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d25f5-b892-46ce-af2d-03b8cf695830 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.529323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d25f5-b892-46ce-af2d-03b8cf695830 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.530070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d25f5-b892-46ce-af2d-03b8cf695830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:03.554630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:03.555584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:03.556472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:03.556472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:03.556472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:03.556472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:03.556472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 309/624] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:03.563430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:03.599524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:03.608799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d25f5-b892-46ce-af2d-03b8cf695830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.610356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d25f5-b892-46ce-af2d-03b8cf695830 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.715968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 316/625] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:03.717310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e61c4-0b74-4661-889e-b6c05e380c5a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.717598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e61c4-0b74-4661-889e-b6c05e380c5a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.717875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e61c4-0b74-4661-889e-b6c05e380c5a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.724026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 317/626] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:03.728468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e61c4-0b74-4661-889e-b6c05e380c5a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:03.733352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:03.748989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0af0-2d4e-4613-862c-fd4adb9864d6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.792216 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.793041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.793325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.793599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.794750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:03.795064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.796458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e13df-4590-4dec-aaec-82bb7021c37a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.814160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 310/627] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:03.815787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.816288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.816762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.842228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:03.843444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:03.849511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:03.865617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e61c4-0b74-4661-889e-b6c05e380c5a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:03.914464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:03.916104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:03.916565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:03.917007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:03.931222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:03.933229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:03.942013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 311/628] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:03.942013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:03.974479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:03.975431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:03.976401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:03.976401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:03.976401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:03.976401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:03.980648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 318/629] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:03.981731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.029617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.064139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ca18-c865-4350-99e7-a5b7de817f98 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.103952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1251-d3b5-4282-95f4-f6fdc1e5f63b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.112709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.113515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.113802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.114105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.124120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.125602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:04.139669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:04.140723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:04.141620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 312/630] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:04.142164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.147789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02714ec4-a04f-42c5-ad98-2dd1908eae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.148589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714ec4-a04f-42c5-ad98-2dd1908eae85 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.148875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714ec4-a04f-42c5-ad98-2dd1908eae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.149151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714ec4-a04f-42c5-ad98-2dd1908eae85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.159353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714ec4-a04f-42c5-ad98-2dd1908eae85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-02714ec4-a04f-42c5-ad98-2dd1908eae85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:04.167949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:04.168861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:04.169720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 319/631] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:04.170464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c2b5-e03a-4386-81ba-b467821e72e1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.170648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c2b5-e03a-4386-81ba-b467821e72e1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.170967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c2b5-e03a-4386-81ba-b467821e72e1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.172506 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 320/632] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:04.173173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0a22-e31e-472a-81d8-8466b9c6bfaf None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.173449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0a22-e31e-472a-81d8-8466b9c6bfaf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.173725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0a22-e31e-472a-81d8-8466b9c6bfaf None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.174956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 321/633] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:04.175647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0a22-e31e-472a-81d8-8466b9c6bfaf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.180572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.247405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2abb9-fd85-4c6d-ad0a-15d505df60ad None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.277868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0a22-e31e-472a-81d8-8466b9c6bfaf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.279252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.279899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.280180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.280452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.281157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:04.281458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.282861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.291860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.296753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 313/634] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:04.297526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.315385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.316079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.316363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.316645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.317423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:04.317731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.319201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6a4d8-b31d-422e-8522-8614a14c45ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.331179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 322/635] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:04.332368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1a85-5f01-40e8-90e5-911c43b6f112 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.332659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1a85-5f01-40e8-90e5-911c43b6f112 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.332938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1a85-5f01-40e8-90e5-911c43b6f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.349014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-623f1a85-5f01-40e8-90e5-911c43b6f112 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:04.350251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-623f1a85-5f01-40e8-90e5-911c43b6f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:04.393920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f505f6c-f6aa-4cf8-abe2-c7721954aa19 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.406050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.416682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 323/636] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:04.417914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.418245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.418527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.429240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.430110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.430566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.430988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.431890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:04.432357 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.433876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.434288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:04.435474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:04.443339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 314/637] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:04.444201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.502500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.503051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 324/638] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:04.503864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.558771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69882f-46b6-4540-9862-e16b200f1466 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.591425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.592210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.592495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.592781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.599488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.600885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9da427-9eba-4c81-a21f-38f37e5874c5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.600996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:04.615471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:04.616515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 315/639] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:04.622237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.623613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.635436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.636701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.636983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.637264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/1e132b21d8bb426391e00c48f22b9922/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.652507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=1e132b21d8bb426391e00c48f22b9922, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.654050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.718527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8119fd-c274-4bc8-a172-67179e6b0933 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.726893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 325/640] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:04 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/1e132b21d8bb426391e00c48f22b9922/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:09:04.727997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.751399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.769843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.770925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.771322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.771699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.785167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:04.794356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:04.795402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:04.796271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 316/641] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:04.796982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.850235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ccb03-c484-4cdd-ad2b-770fa6dacba5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.898940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.900322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.900606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.900883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.916597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:04.916597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:04.917421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0f3e-182b-4c60-ac09-965cf33c1421 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:04.932290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:04.933299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:04.934260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:04.934260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:04.934260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:04.934260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:04.934260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 326/642] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:04.935475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:04.959631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:04.960809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:04.961192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:04.961569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:04.963718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.973517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:04.981850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:04.983000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:04.984071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:04.990342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 317/643] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:04.990342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.037736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.046478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b5ba7-6c97-4d0b-951e-4a944a7203f9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.083425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.084130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.084418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.084696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.085489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.085803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.087851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.099579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 327/644] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.100159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be546fc-08ac-4267-8481-1a90920622fd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.100377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.143498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.144335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.144718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.145097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.145944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.146401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.147877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.160394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 318/645] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.160394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.208618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.225280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896eee-9154-4ffe-ae38-7da8318d290a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.262791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.263608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.263989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.264362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.265183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.265677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.267201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.278181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a291d3d-b765-4b2f-8bb4-8e6c48780149 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.279733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.285890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 328/646] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.285890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.313473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.314178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.314465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.314746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.315548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.316110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.317839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.330850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 319/647] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.330850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.390419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88763b-3c18-4b96-b316-2a46ae5a8b10 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.425888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.426580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.426867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.427145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.428090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=99f73e12101d42c9b94d8b19ec555055) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.428517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.429950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.431855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6010f-7903-4b6e-a9b4-34069c894388 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.442039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 329/648] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/role_assignments?user.id=99f73e12101d42c9b94d8b19ec555055&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.442039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.455329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.494113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.495387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.495868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.496221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.511580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.513813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:05.537632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:05.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:05.543584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:05.543584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:05.543584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:05.543584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:05.543584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 320/649] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:05.543584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.567740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.569521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296787-29d1-4372-85ff-45138a3dd861 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.611158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.611158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.611158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.611158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.621062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.623410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:05.639292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:05.640253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:09:05.641187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:05.643505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 330/650] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:05.644601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.679074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cad49-9bd6-4894-a032-dd61b1910afa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.722750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.723605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.723887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.724163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.735192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.736805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.738319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:05.757694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:05.759120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:05.760042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:05.760042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:05.760042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:05.760042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:05.760042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 321/651] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:05.760315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.775519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e9b78-c837-432c-8234-ce6e9f07ec4d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.820581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.821751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.822110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.822391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.823389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.823697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.825240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.843398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 331/652] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.848245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.854397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:05.885966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cf8f1-e40e-4fe5-82cc-808dc42f0b64 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.925310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:05.926038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:05.926543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:05.926918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:05.927853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:05.928264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:05.929875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:05.954023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 322/653] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:05.954023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:05.962818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371b62f-7524-4ca5-b5de-108151f4bdd6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:05.992438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.001018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.002005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.002145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.002423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.003162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:06.003477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.004866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.017526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 332/654] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:06.018424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.065645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f01d-d611-41da-9520-0e682f2af3ed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.093695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.106381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.107271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.107672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.107952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.120750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.122377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:06.138983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:06.139987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:09:06.140951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:06.144937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 323/655] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:06.145768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.146473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aa09d-10a6-41b8-a190-9af7f63bf913 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.198402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.199261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.199543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.199823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.261129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1d3e5-2648-47fd-97f0-0258ab2d9a4e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.262537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.278359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.279679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.301477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.302404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.302690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.302967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.311453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.313043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:06.329231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:06.330252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:06.331209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 324/656] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:06.332684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.382828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.387367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 333/657] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:06.388464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.442110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a510-76f2-42a8-9b0a-96ee6959568d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.479235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.479874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.480167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.480441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.481272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:06.481577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.483451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.484079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.495983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30cd5e-c8f6-40ba-86ef-cb9c344c3213 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.506973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 325/658] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:06.507863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.537701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.538621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.538911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.539190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.540388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:06.541174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.542974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.567254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 334/659] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:06.568112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.618405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5006d-841f-4037-90a5-87786f51fdd9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.621824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.657747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.659098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.659579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.660055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.671718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.673413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.702692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7977-4943-4dfb-b8ff-f0cecaf3885e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:06.702879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:06.703714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:06.704616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:06.704616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:06.704616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:06.704616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:06.704616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 326/660] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:06.704616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.740078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.740751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.741040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.741322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.760206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.816828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.818242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.829476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93e031-125e-4dc9-ac41-b61a18bb517f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:06.865401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43b058-0aec-4e24-88f1-b099a8796908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:06.866060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b058-0aec-4e24-88f1-b099a8796908 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:06.866344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b058-0aec-4e24-88f1-b099a8796908 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:06.866625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b058-0aec-4e24-88f1-b099a8796908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:06.892007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:06.924112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 335/661] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:06.924871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:06.942203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43b058-0aec-4e24-88f1-b099a8796908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:06.943675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43b058-0aec-4e24-88f1-b099a8796908 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:06.974304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.026992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec8d88-6dfa-4967-a811-d423d74a1411 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.062057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.068161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 327/662] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:07.068296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.068296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.068296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.068296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:07.068600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67bb82-b76f-4bbd-aebe-d3d3b04f4bd9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.068670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.068737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67bb82-b76f-4bbd-aebe-d3d3b04f4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.068737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67bb82-b76f-4bbd-aebe-d3d3b04f4bd9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.068865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.068933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 328/663] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:07.068933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67bb82-b76f-4bbd-aebe-d3d3b04f4bd9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.082688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 336/664] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:07.088179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.137677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.185121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67bb82-b76f-4bbd-aebe-d3d3b04f4bd9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.200862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe25c0d-17b3-4331-90a1-1ef1505b7d03 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.207584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.226267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.227061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.227379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.227658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.235242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.236102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.236395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.236687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.238905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.240574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.250433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.252608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a9207f85-e836-4b4e-b684-f5f4afcee5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:07.261245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:07.262253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:07.263154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:07.263154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:07.263154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:07.263154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:07.263368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 329/665] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:07.264522 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.264812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.265090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:07.277135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:07.278101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:07.278974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:07.278974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:07.278974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:07.278974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:07.278974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 337/666] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:07.279251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.287195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:07.288654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:07.359369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 330/667] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:07.366962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.394931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7834c-eee6-436d-9898-86cd0dc5b6a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.412142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.428504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.429646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.429646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.429889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.437222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.438703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:07.453178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:07.454124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:07.455022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:07.458314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 338/668] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:07.458956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.477832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cda84-6c9f-4be5-b144-df7b726bd8aa None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.479401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.515646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.516360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.516643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.516917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.517636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:07.517939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.519339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.531109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 331/669] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:07.531935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.568421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b664a-1abb-436f-8147-fbfdb2594b58 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.607772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.608448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.608734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.609013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.609789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:07.610070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.611440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.623416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 339/670] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:07.624233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.645644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.650165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3cfc-8b18-49bd-8ec5-e8346673936a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.685503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.686331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.686616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.686910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.697925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:07.705668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:07.706803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:07.707659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:07.708295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.708367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 332/671] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:07.708367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.730926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cc793-3252-4eb7-bb48-5cd1030e5b5a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.765473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.766181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.766464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.766745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.767536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:07.767852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.769288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.781089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 340/672] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:07.781878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.810540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249ce84-555e-4812-bd71-2c150cf6bbdd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.843033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a1046-b230-4797-af74-bea93e038191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.843812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a1046-b230-4797-af74-bea93e038191 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.844098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a1046-b230-4797-af74-bea93e038191 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.844378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a1046-b230-4797-af74-bea93e038191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.850855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a1046-b230-4797-af74-bea93e038191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.852831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a1046-b230-4797-af74-bea93e038191 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-729a1046-b230-4797-af74-bea93e038191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:07.867023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:07.868028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:07.869431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 333/673] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:07.870143 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b078-94a6-4177-b28c-9650f59b1a56 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.870462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b078-94a6-4177-b28c-9650f59b1a56 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.870642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b078-94a6-4177-b28c-9650f59b1a56 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.871910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 334/674] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:07.872602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b078-94a6-4177-b28c-9650f59b1a56 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.886087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fe756-62d8-489d-9e98-c0ff999f525a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:07.891209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.920588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:07.921306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:07.921596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:07.921858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:07.932860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:07.935559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:07.938303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:07.950791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:07.957785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 341/675] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:07.958901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:07.994608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b078-94a6-4177-b28c-9650f59b1a56 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.027512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.028160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.028440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.028714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.029448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.029747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.031169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.039062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 335/676] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.040345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.066683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3527-88a9-46c3-8b0c-2ad4b210d2d1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.100238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.100897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.101181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.101460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.102863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=f2124f6539264fa3a4b0ec190e23b2d5) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.103280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.104635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4290f5-0c20-4e3d-b3f4-db062410bb25 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.122137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 342/677] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:07 2022] GET /identity/v3/role_assignments?user.id=f2124f6539264fa3a4b0ec190e23b2d5&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.122137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.122137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.122137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.135756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:08.136053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:08.137281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:08.148022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b07efe-e588-48b1-bc41-51814c5740b1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.186990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.187758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.188104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.188446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.189308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.189685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.191273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.202018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:08.204950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 336/678] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.205811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.220215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 343/679] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:08.221745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.318410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60195c4-0eed-42d0-902d-937a46502b89 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.348484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f7411-51c3-4a53-8403-b4dde02b201e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.357716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.358853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.359210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.359554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.360999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.361380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.363457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.375501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:08.380643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 337/680] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.381411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.383439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.387220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.387220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.387220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.395636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.397115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:08.416036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:08.416942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:08.417841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:08.417841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:08.417841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:08.417841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:08.417841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 344/681] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:08.419065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.470575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:08.503033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648af0-3c7c-499f-946b-bf23e5fed419 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.529208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382a4d5-2db9-4fa5-ad1c-003f3339f6dc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.551191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.552692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.553473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.553948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.555742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=f08d1a5b8e594901b986f1bde71e015a) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.556526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.558836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.566588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.567559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 338/682] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/role_assignments?user.id=f08d1a5b8e594901b986f1bde71e015a&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.568646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.572445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.572769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.573060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.622645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:08.637476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:08.638592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:08.639453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:08.646963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:08.652662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 345/683] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:08.652662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.763312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6ce8-fd80-4e0c-85bb-62aea0131ea9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.798251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17ac2-d1bf-4414-b528-e870c4f18035 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:08.801517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:08.841471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625611-bfa7-442e-9029-20397686f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.842677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625611-bfa7-442e-9029-20397686f615 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.843377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625611-bfa7-442e-9029-20397686f615 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.843894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625611-bfa7-442e-9029-20397686f615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.844494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625611-bfa7-442e-9029-20397686f615 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=0db4109ed2c6485eb033cb10eee8e67b) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.844810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625611-bfa7-442e-9029-20397686f615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.849770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625611-bfa7-442e-9029-20397686f615 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.854683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 339/684] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/role_assignments?user.id=0db4109ed2c6485eb033cb10eee8e67b&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.855665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625611-bfa7-442e-9029-20397686f615 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:08.863539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:08.864475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:08.864916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:08.865200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:08.865946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:08.866285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:08.867676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:08.912637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 346/685] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:08.919030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.092041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625611-bfa7-442e-9029-20397686f615 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.126269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:09.128210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1441-df58-47c9-8539-156b39d0450a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.141164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.141840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.142148 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.142422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.143174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:09.143478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.144875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.158910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 340/686] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:09.160176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.175408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.176393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.176686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.177235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.187432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.189619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:09.210164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:09.211137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:09.212150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:09.212691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 347/687] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:09.218749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.280264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8bbe8-ee5e-4719-b4a6-096e5693ed6f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.288008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:09.320676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.321987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.322472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.323239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.338022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.340343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:09.362697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:09.363866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:09.364966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:09.364966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:09.364966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:09.364966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:09.369987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 341/688] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:09.372087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.384091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4b72f-127f-4a6b-9df9-7b69f6b7d249 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.430390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:09.453082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.453759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.454055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.454335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.455181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:09.455491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.456920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.492607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 348/689] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jun 20 12:09:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:09.500672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.540918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8687f-a0ce-492b-aceb-2c078989d844 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.606962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.607901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.608184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.608455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.609172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:09.609475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.611144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.628873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 342/690] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:09.630505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.642659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:09.675573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a933f8-35a9-417a-a73e-cbf31f6b5b06 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.739989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.740561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.740844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.741116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.800376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cabd-4d8a-44ef-831f-f015d01e54c1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:09.802252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:09.860565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:09.861354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:09.861636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:09.861912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:09.863486 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.864936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.879105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:09.880582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:09.905680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:09.906782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:09.907818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:09.911121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 343/691] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:09:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:09.918704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:09.990434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.026181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 349/692] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:10.032184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.084429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9320-6083-492b-9155-049cf14ce44b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.153944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.154993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.155480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.155973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.156998 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:10.157505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.159165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.186400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 344/693] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:09:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:10.189504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.230961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.235758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0592d-ab97-471d-9570-a6390039a965 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.272467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.273570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.274132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.274636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.285804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.287586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:10.308214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:10.309172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:10.310080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:10.310080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:10.310080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:10.310080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:10.312389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 350/694] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:10.318238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.378453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.398247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f3d-6fc8-48ca-a693-91bd04fb1096 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.432928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2415-ae6c-4b74-9fd8-4d107e1d3613 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.456067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ded8c-bb94-42ac-be68-01781c562151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.456722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ded8c-bb94-42ac-be68-01781c562151 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.457009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ded8c-bb94-42ac-be68-01781c562151 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.457288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ded8c-bb94-42ac-be68-01781c562151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.473094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.474123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.474596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.475057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.476057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:10.476571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.478863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b038f-c2ba-4a5d-a203-8022c80170f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.492581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 351/695] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:10.494639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d602df-d108-4b11-a38d-e2bb5261a119 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.495136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d602df-d108-4b11-a38d-e2bb5261a119 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.495653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d602df-d108-4b11-a38d-e2bb5261a119 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.497452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 352/696] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:10.498499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d602df-d108-4b11-a38d-e2bb5261a119 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.530820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ded8c-bb94-42ac-be68-01781c562151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.532280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ded8c-bb94-42ac-be68-01781c562151 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.554570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.611040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d602df-d108-4b11-a38d-e2bb5261a119 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.614355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.636854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 345/697] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:10.638201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.638492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.638773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.648814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.650543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.651088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.651568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.656111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:10.657317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:10.659605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.661365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:10.677441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:10.678426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:10.679312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:10.681914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 353/698] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:10.683021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.751296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 346/699] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:10.752554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.790719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993f76-a760-42fa-9589-41c2032d3fda None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.809522 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.828218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.829355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.829842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.830347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.842338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.844141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.862678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a231a1d-61b3-4650-b542-31a75a019125 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:10.864665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:10.865527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:10.866463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:10.866463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:10.866463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:10.866463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:10.868697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 354/700] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:10.869718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.879168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.900231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:10.900889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:10.901174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:10.901460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:10.902281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:10.902614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:10.904046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:10.917435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 347/701] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:10.919514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:10.981686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e63c7-ead9-440f-90e1-a421250e7391 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.019411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.020192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.020476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.020749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.029504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f09353-5cd2-45e5-b506-5d33d168e5dc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.031470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.032903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.042300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:11.050973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:11.057557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:11.059274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:11.059274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:11.059274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:11.059274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:11.059274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 355/702] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:11.059274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.077759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.078698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.079252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.079252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.079966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:11.080271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.081716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974260-049b-45a9-9ef5-d8dac0b4abaf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.095780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 348/703] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:11.097127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4237-ff29-4936-9ab0-d20336930557 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.097411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4237-ff29-4936-9ab0-d20336930557 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.097685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4237-ff29-4936-9ab0-d20336930557 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.103241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 349/704] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:11.103241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c4237-ff29-4936-9ab0-d20336930557 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.135203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.175830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a01461-fd46-4c28-a332-62ebd0de9a25 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.213206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.213891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.214224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.214499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.215331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=1e132b21d8bb426391e00c48f22b9922) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:11.215694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.216299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c4237-ff29-4936-9ab0-d20336930557 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.217080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.223889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 356/705] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/role_assignments?user.id=1e132b21d8bb426391e00c48f22b9922&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:11.224513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.263086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.264244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.264822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.265322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.266329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:11.266857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.268490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbed2-9f05-45fd-8d4b-48dba0813a57 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.287031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 350/706] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:11.289246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.289868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.290437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.310261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:11.311950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:11.340104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65cf10-e96a-4ecf-bc4a-3a711a183901 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.341729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.365885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.378833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.379701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.379989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.380323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.388751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.390285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.400802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 351/707] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:11.402185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:11.409385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:11.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:11.412741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 357/708] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:11.419180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.524118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8d43-7a7d-4cc2-aa8e-5fbddec6c666 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.546228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5d12-043a-4d77-b616-3dbe155f8dd6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.569206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08548f6-f17f-4f02-b4cd-be9b797ed342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.570377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08548f6-f17f-4f02-b4cd-be9b797ed342 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.571320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08548f6-f17f-4f02-b4cd-be9b797ed342 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.571912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08548f6-f17f-4f02-b4cd-be9b797ed342 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.572908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08548f6-f17f-4f02-b4cd-be9b797ed342 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.574962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08548f6-f17f-4f02-b4cd-be9b797ed342 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.582276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.583377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.584024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.584312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.585548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:11.585767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.587271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.599605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 358/709] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:11.600418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.643564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.698719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7170-ce32-4ee3-b9ef-0bb4bac2b679 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.734817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 352/710] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:09:11 2022] POST /identity/v3/users => generated 254 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:11.736989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3dfdd-6ead-4143-b389-bcf2d043c94c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.737328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3dfdd-6ead-4143-b389-bcf2d043c94c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.737518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3dfdd-6ead-4143-b389-bcf2d043c94c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.738665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.739166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 353/711] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:11.750823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.750823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.751023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3dfdd-6ead-4143-b389-bcf2d043c94c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.751099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.751099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.751099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9e3f8d61-fa45-4242-bafe-0d8f9fb94a31 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:11.765680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:11.766837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:11.767675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 359/712] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:11.769047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.769213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.769366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.775540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.798833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:11.800217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:11.895905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 360/713] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:11.896212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:11.903621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3dfdd-6ead-4143-b389-bcf2d043c94c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:11.946990 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.955712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:11.956093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:11.956377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:11.956653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:11.957484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=99f73e12101d42c9b94d8b19ec555055) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:11.957936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:11.970422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:11.970422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 354/714] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/role_assignments?user.id=99f73e12101d42c9b94d8b19ec555055&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:11.970422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:12.038022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3256d-0420-4731-8a31-3600ad633f09 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:12.077765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:12.095206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:12.102134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:12.102134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:12.102134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:12.102134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:12.102134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:12.102134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:12.103092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf327-b8c7-4d5a-aa3a-1fc38e3fba5d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:12.110048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 361/715] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:12.112443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:12.146252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:12.147231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:12.147515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:12.147795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] PATH_INFO: `/v3/services/network` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:12.148474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:12.150477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:12.168404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:12.169453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:12.170327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 355/716] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:11 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:12.177098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:12.244359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:12.248010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994290a-b3f9-47b5-a366-22a7dee5228c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:12.290163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d5a3-edf9-4787-ad42-c0b7037bf7df None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:12.296448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e144d-6502-4752-befe-b67670feb996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:12.297374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e144d-6502-4752-befe-b67670feb996 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:12.297949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e144d-6502-4752-befe-b67670feb996 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:12.298429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e144d-6502-4752-befe-b67670feb996 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:12.299326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e144d-6502-4752-befe-b67670feb996 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:12.299816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e144d-6502-4752-befe-b67670feb996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:12.310021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e144d-6502-4752-befe-b67670feb996 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:12.319976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 362/717] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jun 20 12:09:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:12.337424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:12.338248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:12.338629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:12.338982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:12.339779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] RBAC: Adding query filter params (name=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:12.340168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:12.341694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e766ce-0260-44e6-8af0-59990757425d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:12.347411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 356/718] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:12.352735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e144d-6502-4752-befe-b67670feb996 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:12.493150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e144d-6502-4752-befe-b67670feb996 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:12.529193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:12.530191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:12.530685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:12.531142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:12.532033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] RBAC: Adding query filter params (type=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:12.532521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:12.534089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a11c0a-1112-4637-92a7-004bb8818687 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:12.539909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 363/719] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:13.681813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd359b7-0f6c-482d-99c9-3db6380bc25c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:13.682875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd359b7-0f6c-482d-99c9-3db6380bc25c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:13.683390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd359b7-0f6c-482d-99c9-3db6380bc25c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:13.685238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 357/720] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:13.690360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:13.691176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:13.691676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:13.714071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:13.715605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:13.758454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:13.820042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 364/721] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:13.857833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd359b7-0f6c-482d-99c9-3db6380bc25c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:13.870069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:13.990478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd359b7-0f6c-482d-99c9-3db6380bc25c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:14.047938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30775884-5982-4586-8ac7-072582f7176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:14.048750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30775884-5982-4586-8ac7-072582f7176f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.049038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30775884-5982-4586-8ac7-072582f7176f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.049319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30775884-5982-4586-8ac7-072582f7176f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.067222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30775884-5982-4586-8ac7-072582f7176f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-30775884-5982-4586-8ac7-072582f7176f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:14.080517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:14.081432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:14.082300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:14.087196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 358/722] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:14.093442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:14.223306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16110aca-a12a-423e-b0fd-f00faa9d5c40 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:14.275498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:14.276099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.276383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.276660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.277417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:14.277725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:14.279136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec7acd-9daa-4def-93c1-360d70d97175 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:14.294647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 365/723] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:14.300151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30775884-5982-4586-8ac7-072582f7176f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:14.378842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396acf2-5d60-40ca-972c-c973636769d8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.379192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396acf2-5d60-40ca-972c-c973636769d8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.379404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396acf2-5d60-40ca-972c-c973636769d8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.380989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 366/724] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:14.386281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.386516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.386798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.396960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:14.425425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:14.428322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:14.459332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:14.465688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30775884-5982-4586-8ac7-072582f7176f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:14.513785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:14.514633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.514920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.515199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.526533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:14.527944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:14.539875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 367/725] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:14.549416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:14.550505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:14.551532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:14.551532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:14.551532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:14.551532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:14.555507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 359/726] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:14.556441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:14.569729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:14.705387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e258e-2f91-4cdb-8cf2-3fd376668698 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:14.715477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f561-b6ad-43f1-91a8-75fd87e07564 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:14.726221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:14.741622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676f87-a43b-4b7c-b156-0b39f330b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:14.742537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676f87-a43b-4b7c-b156-0b39f330b74f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.742932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676f87-a43b-4b7c-b156-0b39f330b74f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.743312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676f87-a43b-4b7c-b156-0b39f330b74f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.754890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676f87-a43b-4b7c-b156-0b39f330b74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:14.756336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:14.757065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.757419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.757755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.759123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:14.759494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:14.760933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df5eaa-e9b4-4b79-936f-2fe5a394799c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-de676f87-a43b-4b7c-b156-0b39f330b74f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:14.764292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:14.765220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:14.766097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 360/727] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:14.767683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb3e1c-f650-4d59-8cb8-5be75eeb5278 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.767683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb3e1c-f650-4d59-8cb8-5be75eeb5278 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.767931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb3e1c-f650-4d59-8cb8-5be75eeb5278 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.771600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 361/728] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:14.771600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb3e1c-f650-4d59-8cb8-5be75eeb5278 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:14.779611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 368/729] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:14.781836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.782216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.782568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.800324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:14.801740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:14.804652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:14.875008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 369/730] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:14.875935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:14.915832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb3e1c-f650-4d59-8cb8-5be75eeb5278 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:14.952681 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:14.958330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.958330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.958330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.958330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:14.958330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:14.958330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafe9d-7a5d-4a37-8c75-5cfcaef81956 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:14.964777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 362/731] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:14.966169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765d5f-1484-4159-82ca-63821d66ca91 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:14.966455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765d5f-1484-4159-82ca-63821d66ca91 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:14.966734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765d5f-1484-4159-82ca-63821d66ca91 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:14.969446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 363/732] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:14.969446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0765d5f-1484-4159-82ca-63821d66ca91 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.024501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf10ffc-688f-46a1-86b2-13b2fee59400 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.031502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.062142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.062955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.063245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.063905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.072017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.073480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.076556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:15.089326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:15.090594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:15.091601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 370/733] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:15.092207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.096730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0765d5f-1484-4159-82ca-63821d66ca91 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.142101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237ee2d-94c9-49ba-90ef-bab78e0eccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.142983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ee2d-94c9-49ba-90ef-bab78e0eccce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.143275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ee2d-94c9-49ba-90ef-bab78e0eccce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.143555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ee2d-94c9-49ba-90ef-bab78e0eccce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.154362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237ee2d-94c9-49ba-90ef-bab78e0eccce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7237ee2d-94c9-49ba-90ef-bab78e0eccce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:15.161913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:15.162873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:15.164002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:15.168592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 364/734] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:15.169891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.170848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.170848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.187909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:15.189119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:15.201606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74098-0a71-444c-8fcc-5ccd4859a0a8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.238025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.238834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.239122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.239404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.250727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.252189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.266017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 365/735] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:15.266017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:15.278369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:15.279552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:15.280584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:15.280584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:15.280584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:15.280584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:15.280584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 371/736] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:15.281148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.298076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.356594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.383568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f8d5-939c-47ca-aa74-7f688bb6d385 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.409583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f863c-0e23-4134-a40a-3ba296d51ed6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.418394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.419062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.419343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.419619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.420447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:15.420753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.422220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.439636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 366/737] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:15.440505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.452570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.453248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.453536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.453819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.454606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:15.455253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.456296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.464450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 372/738] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:15.465273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.527796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.536954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb7d1-a483-4e81-ace7-03c6cb8da3c8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.568962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b4abd-ae40-4a43-9a7b-564e42a9fba9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.571913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.572611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.572904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.573184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.573906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:15.574247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.575627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d23ab2-ca39-4c17-bc95-6c7415802211 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.582129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.587112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 367/739] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:15.588355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9eaed-bc3e-43d9-8f8a-79c63f3895ae None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.588648 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9eaed-bc3e-43d9-8f8a-79c63f3895ae None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.588964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9eaed-bc3e-43d9-8f8a-79c63f3895ae None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.590265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 368/740] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:15.590974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9eaed-bc3e-43d9-8f8a-79c63f3895ae None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.607666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.608349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.608636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.608915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.609635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.611036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.691950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9eaed-bc3e-43d9-8f8a-79c63f3895ae None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.718593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 373/741] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:15 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:15.719695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.734072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2120-8f7e-4b3d-ac13-5f50fe532ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.734820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2120-8f7e-4b3d-ac13-5f50fe532ecc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.735103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2120-8f7e-4b3d-ac13-5f50fe532ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.735378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2120-8f7e-4b3d-ac13-5f50fe532ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.756705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:15.829361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c2120-8f7e-4b3d-ac13-5f50fe532ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.830831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c2120-8f7e-4b3d-ac13-5f50fe532ecc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.852467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5451-8140-454a-b188-e9a1dfbf1982 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:15.892793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:15.893605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.893896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.894230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:15.906552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:15.908024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:15.926350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:15.927591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:15.928630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:15.928630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:15.928630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:15.928630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:15.928630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 374/742] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:15.931303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:15.950064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 369/743] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:15.951423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:15.951715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:15.954629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.003049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:16.004223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:16.018171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.050078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.081480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 370/744] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:16.082734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.120308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2189-9374-42da-b8fc-8d2f9e7ee78f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.162632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.163456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.164005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.164458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.172930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.174419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:16.189547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:16.190890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:16.192236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:16.195428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 375/745] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:09:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:16.196321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.213476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da0ec6-18de-4247-9cc2-b8059ab345ec None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.250896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.251996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.252294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.252579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.253469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:16.253785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.255219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.267852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 371/746] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:16.268536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.290135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.305876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8b652-8f7a-43a6-a962-3797268fc043 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.307053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.338262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.338987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.339266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.339544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.354910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.356393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:16.374165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:16.375097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:16.376079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:16.376079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:16.376079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:16.376079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:16.376311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9007-a657-4ba5-a849-3fe869b8d3f0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.379959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 376/747] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:16.380816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.416087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.416942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.417390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.418326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.419278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.420673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.483435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d811-97d9-4707-a733-b7fc386daa31 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.488503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 372/748] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:16 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:16.489478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.548523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.549674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.550347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.550736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.551805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:16.552265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.554070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.559080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.584768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 377/749] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:16.584768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.636841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.646112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202c01f-466a-4f5e-930b-a771409baa9c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.696421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.696421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.696871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.697796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.705678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.706856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859168-cf2d-49e5-951e-9a11a514b276 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.707265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:16.725936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:16.726970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:16.728164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 373/750] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:16.729088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.750694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.751378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.751668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.751949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.752677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:16.752990 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.754710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.768311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 378/751] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:16.768311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.827305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.854322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5057-1629-4f19-8a7b-f093271a423c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.878807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b576d-dbe2-43ce-af36-06ecaaaf184c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:16.893793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.894812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.895297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.895865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.915933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:16.916605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:16.916895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:16.917179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:16.918047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:16.920198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.920198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:16.928862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:16.938642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 379/752] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:16.939499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:16.971898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:16.973378 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.077197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ee529-07e8-4563-ac9c-9a2ff6740901 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.089332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.111860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 374/753] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:09:17.113114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.121356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.122217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.122511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.122797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.131822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.134380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:17.153586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:17.154567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:17.155516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 380/754] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:17.156003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.191909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.251571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea77b9-6597-47df-8932-7340d92d05d5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.298296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.299449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.299762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38b5b-7dd9-4451-82ab-469eeb5ab94f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.300169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.300644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.312195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.313972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:17.342043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:17.343011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:17.343900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:17.343900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:17.343900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:17.343900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:17.346286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 375/755] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:17.347300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.353218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.354290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.354700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.355085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.367202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.369363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:17.388070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:17.389262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:17.390381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:17.390381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:17.390381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:17.390381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:17.396239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 381/756] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:17.397217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.425002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.458905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28318ec3-04a6-47ca-a31c-e4e17e0548ce None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.468822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.495137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.496043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.496470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.496882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.497789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:17.498274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.499847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.509525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69ae0-7e83-4794-b3db-cbdffac46369 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.512957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 376/757] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:17.514089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.546521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.547513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.547717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.548117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.549003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:17.549414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.550988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.570573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 382/758] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:17.571607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.622319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0dc7-99f4-48f7-823b-fad521e72037 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.657050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.657948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.658394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.658810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.658966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.659826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:17.660262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.661773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.675898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 377/759] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:17.676954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.684830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414439-5967-483b-b3ac-9b0be5197875 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.706794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.723958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.724860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.725239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.725624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.726652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=1e132b21d8bb426391e00c48f22b9922) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:17.727629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.729241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.735930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 383/760] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/role_assignments?user.id=1e132b21d8bb426391e00c48f22b9922&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:17.736931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.793039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2d822-a330-490e-9770-939cb93f1db8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.831579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.832394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.832677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.832951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.841273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.842916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.853818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5dc3c-d58a-40f7-b1ee-03a8645c52ec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-05185453-ea97-4a0b-b696-8761fae98c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:17.859060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:17.860310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:17.861206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 378/761] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:17.862176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b77c-79c3-4653-ad95-8053f5117315 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.862370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b77c-79c3-4653-ad95-8053f5117315 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.862992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b77c-79c3-4653-ad95-8053f5117315 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.864755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 379/762] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:17.871405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b77c-79c3-4653-ad95-8053f5117315 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:17.907827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:17.909049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.909483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.909934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.919424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:17.921005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3a6e9c8d-c021-48d8-9dcf-b55e485c64d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:17.935967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:17.937049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:17.938177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:17.942054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 384/763] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:17.943354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:17.943648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:17.943927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:17.955597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.961043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:17.962807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:17.981391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:17.997200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b77c-79c3-4653-ad95-8053f5117315 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.031908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.032622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.032907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.033183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.033971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:18.034307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.035750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.047922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 385/764] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:18.049034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.059667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 380/765] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:18.060836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.183537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb667eb-8004-454f-a3fe-38652c60576e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.191910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577691e-0af1-4e55-b982-ae86b08f2bab None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.226435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.227908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.228592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.229470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/99f73e12101d42c9b94d8b19ec555055/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.232651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=99f73e12101d42c9b94d8b19ec555055, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.234911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.237197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.237948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.238332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.238683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.239846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:18.240752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.242461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.245266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:18.260064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 386/766] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:18.260064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.326333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 381/767] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:18 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/99f73e12101d42c9b94d8b19ec555055/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:09:18.327367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.348700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:18.377753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9682-9bab-4b24-b418-0dd3d6096e57 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.427457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572656-362d-49a1-acad-11466d1302ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.429245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572656-362d-49a1-acad-11466d1302ea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.431036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572656-362d-49a1-acad-11466d1302ea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.432879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572656-362d-49a1-acad-11466d1302ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.433744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51572656-362d-49a1-acad-11466d1302ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.436589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51572656-362d-49a1-acad-11466d1302ea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-51572656-362d-49a1-acad-11466d1302ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:18.465063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:18.466264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:18.467266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:18.478432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 387/768] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:18.500619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572656-362d-49a1-acad-11466d1302ea None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.536638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c89c-e158-4ea5-bdd3-1cb1da861fe2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.568837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:18.573970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.574660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.575018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.575210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.576034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=868589ee9f3c4265abd3916bfa2266c0) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:18.576343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.577779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.584297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 382/769] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/role_assignments?user.id=868589ee9f3c4265abd3916bfa2266c0&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:18.619546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572656-362d-49a1-acad-11466d1302ea None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.659183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.660180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.660615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.661035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.662020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:18.662508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.664355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6e680-fd14-4459-a9db-875d1537d42e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.670339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 388/770] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:18.676322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.783710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:18.795352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c314af-937a-40b4-99b2-c68c6ace2052 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.800753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c314af-937a-40b4-99b2-c68c6ace2052 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.800753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c314af-937a-40b4-99b2-c68c6ace2052 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.800753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 389/771] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:18.815381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.815669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.815959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.826044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc998-2f99-432b-ab72-3403697b583f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:18.850199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:18.851412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:18.868000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:18.869449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:18.869919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:18.870404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:18.871373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:18.871861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:18.873608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:18.880693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 383/772] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:18.900338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:18.980568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 390/773] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:19.000818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:19.072885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:19.120904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7c4a3-cc1b-49ee-9ced-d00ef8c7662e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.124853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab32f-b7d4-4b15-b45a-f8cb4501300b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.172465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.173132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.173416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.173692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.174208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.174517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] RBAC: Adding query filter params (interface=public, service_id=5861a81130bc49c8b76c8c69e7598d8d, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:19.174829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.175659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.176146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.176250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.176724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] PATH_INFO: `/v3/services/network` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.177595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.179302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.184207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 384/774] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/endpoints?service_id=5861a81130bc49c8b76c8c69e7598d8d&interface=public®ion_id=RegionOne => generated 194 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:19.184544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:19.190978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:19.202704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:19.203708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:19.204546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:19.208641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 391/775] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:18 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:19.209779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:19.313312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1fb8e-0cc6-4cd1-a516-11954eb9d59f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.331438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:19.350119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.351010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.351543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.351982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.352859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] RBAC: Adding query filter params (name=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:19.353309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.354845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.363804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 392/776] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:19.366751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:19.433447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52059f9-04a7-4876-ad08-d09905e49c9f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.472362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4655c-6f64-4bcd-9941-c28a7185e928 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.510533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.511444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.512217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.513128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.513980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:19.514970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.516908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.519649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.520496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.520919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.521335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.523108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.526067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.528269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 393/777] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:19.534326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 385/778] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:19 2022] GET /identity/v3/services => generated 772 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:19.541284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:19.596354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:19.658305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26edcb-8a57-4686-a844-95ed5b3d82ae None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.695635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.697249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.697679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.698125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.699059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] RBAC: Adding query filter params (interface=public, service_id=1bfab8898bff41feae358621d6be5028, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:19.699538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.701070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8357-f6c7-4d3f-9b67-395bebf2b0df None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.713980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 394/779] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:19 2022] GET /identity/v3/endpoints?service_id=1bfab8898bff41feae358621d6be5028&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:19.715880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:19.796496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:19.838243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534541d-d701-47ad-acfa-c718da1f79ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:19.881637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61352232-ef61-4eaa-b10f-a84f3f336120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:19.883166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352232-ef61-4eaa-b10f-a84f3f336120 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:19.883750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352232-ef61-4eaa-b10f-a84f3f336120 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:19.884245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352232-ef61-4eaa-b10f-a84f3f336120 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:19.885186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61352232-ef61-4eaa-b10f-a84f3f336120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:19.886902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61352232-ef61-4eaa-b10f-a84f3f336120 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:19.893725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 386/780] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:19 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:20.036239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6774-5013-4dbb-a889-ad75094558b7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:20.036754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6774-5013-4dbb-a889-ad75094558b7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:20.036861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6774-5013-4dbb-a889-ad75094558b7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:20.038791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 395/781] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:20.045074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:20.045360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:20.045651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:20.071055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:20.072289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:20.169007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 387/782] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:20.199832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc6774-5013-4dbb-a889-ad75094558b7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:20.331817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc6774-5013-4dbb-a889-ad75094558b7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:20.348291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:20.383679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:20.384488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:20.384781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:20.385061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:20.398285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:20.406538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:20.407498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:20.408364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 396/783] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:20.414088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:20.497414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:20.554065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e253-7955-4b42-855d-f2b6a791feb5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:20.600645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:20.601326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:20.601612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:20.601893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:20.602712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:20.603022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:20.604407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:20.616729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 388/784] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:20.622229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:20.764013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be690-5d03-47bb-992a-dcc5dcef40cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:20.803650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:20.804446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:20.804730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:20.805006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:20.821759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:20.823266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c8db9138-89fe-4cfe-80e4-c0c15fb45d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:20.849233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:20.850244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:20.851146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:20.851146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:20.851146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:20.851146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:20.854404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 397/785] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:20.860412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:20.998740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10912d02-ef8c-4545-82f0-ad3a92fdeb49 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:20.999122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10912d02-ef8c-4545-82f0-ad3a92fdeb49 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:20.999339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10912d02-ef8c-4545-82f0-ad3a92fdeb49 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.000942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 398/786] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:21.011363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5f31-f468-4bd7-bef7-13d128c2cb17 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.011653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5f31-f468-4bd7-bef7-13d128c2cb17 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.011928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5f31-f468-4bd7-bef7-13d128c2cb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.014280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ba89f-d4bb-40cd-926f-be1fe87ea59b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.045832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-357b5f31-f468-4bd7-bef7-13d128c2cb17 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:21.046371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.048808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-357b5f31-f468-4bd7-bef7-13d128c2cb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:21.069414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.071562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.072238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.072526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.072808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.073542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:21.073853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:21.075329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:21.095699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 389/787] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:21.115523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.152513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 399/788] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:21.152513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e53e57-63e1-47a0-8d60-f1d313358b51 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.152513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e53e57-63e1-47a0-8d60-f1d313358b51 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.152513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e53e57-63e1-47a0-8d60-f1d313358b51 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.152513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 400/789] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:21.159130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.160308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.160727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.183862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:21.185359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:21.270228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 401/790] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:21.271524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.373910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e759596-82be-472c-9405-1414af350ad2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.376045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.394826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa265a1-b5aa-4731-825f-404208c3c900 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.414960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.416063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.416458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.416874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.425176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:21.426930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:21.432558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.433517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.433966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.434333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:21.443245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:21.444175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:21.445111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:21.445638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:21.446275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 390/791] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:21.446275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:21.459384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:21.460960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:21.463374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 402/792] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:21.470013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.510283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.586103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b731-1cdb-46c0-82c4-6a0869fb5c32 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.600328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e64811-4198-48f2-a30e-a4ae918d4630 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.629241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.630056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.630343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.630830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.644459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:21.645426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.646390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.646878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.647359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.648397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:21.648989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:21.650683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:21.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:21.653537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:21.654427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:21.658137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 391/793] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:21.659172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.672217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.678203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 403/794] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:21.679232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.795910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.799605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730ce6-e438-4e10-9039-4eead0c514ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.814034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7b35-c23a-4505-96af-85900e45ec7d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.843883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.845120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.845889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.846822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.848071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:21.848819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:21.851130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:21.858692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:21.859716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:21.860293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:21.860720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:21.861623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:21.862105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:21.866810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 392/795] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:21.866810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.868989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:21.882184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 404/796] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:21.883093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:21.951891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:21.979429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902ebb-3596-4934-a267-cefde3bf8c45 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:21.992004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b2e7a-aa4e-4180-9867-b389d098f93f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.017474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.019001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.019494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.019974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.028497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.029294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.029577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.029857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.032705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.034483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.042390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.043877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:22.053918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.054846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.056306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:22.056306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:22.056306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:22.056306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:22.058533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 393/797] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.059535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:22.065745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.066979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.067879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:22.067879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:22.067879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:22.067879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:22.070310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 405/798] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.071424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.088897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.179278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa416-0af1-4e52-92ad-42e292d8b030 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.189278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37913b-9a2b-4d5f-b0e5-bb0a5b221528 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.203882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.215672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.216474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.216819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.217064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.226426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.227952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.228432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.228929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.229217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.230094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:22.230594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.230761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.232368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6eaa48cc-82d7-4d9e-aea1-983e433bbea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:22.250663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.252040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.255181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:22.255181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:22.255181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:22.255181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:22.255409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 406/800] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:22.255409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.255547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 394/800] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.255689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1520-e241-4ef5-93a1-0a66e81d0dc3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.255972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1520-e241-4ef5-93a1-0a66e81d0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.256251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1520-e241-4ef5-93a1-0a66e81d0dc3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.257550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 395/801] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:22.258540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b1520-e241-4ef5-93a1-0a66e81d0dc3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.332078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.365130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f95d9-88df-433d-a956-c8998807ed31 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.368209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b1520-e241-4ef5-93a1-0a66e81d0dc3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.399955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.400612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.400899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.401004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.401176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.401716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.401886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:22.401984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.402251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.402347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.403620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.408795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.410253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.415473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 407/802] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:22.416289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-df21dda7-344d-4066-a382-921f75d78f5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:22.425469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.426628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:22.427750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 396/803] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.428366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9ca0b-43ed-4a60-a9eb-2f07e12eaece None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.428366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9ca0b-43ed-4a60-a9eb-2f07e12eaece None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.428537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9ca0b-43ed-4a60-a9eb-2f07e12eaece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.444253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b7c9ca0b-43ed-4a60-a9eb-2f07e12eaece None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:22.445420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b7c9ca0b-43ed-4a60-a9eb-2f07e12eaece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:22.451641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.510278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 397/804] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:22.511582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734e27-bd46-4f62-b5c9-e3c4b730c359 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.511874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734e27-bd46-4f62-b5c9-e3c4b730c359 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.512156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734e27-bd46-4f62-b5c9-e3c4b730c359 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.513428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 398/805] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:22.514165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17734e27-bd46-4f62-b5c9-e3c4b730c359 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.520670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8020c-e85f-48a9-947e-1150095cab99 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.555498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.556160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.556448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.556728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.557743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:22.557743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.559137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.570804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 408/806] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:22.571758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.578053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.624252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17734e27-bd46-4f62-b5c9-e3c4b730c359 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.659338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.660041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.660321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.660676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.663975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.668333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.669815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.671168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ed11c-2681-4ef0-b102-2741bf915d7d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e3a643f7-f58b-416e-a2b5-186759369dcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:22.683849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.684878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:22.685985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 399/807] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.686742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.686967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.687244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.703615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:22.704789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:22.709837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.710532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.710822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.711103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.712451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:22.712763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.714255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.725583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 409/808] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:22.726399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.770139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 400/809] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:22.770972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.815850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.827788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a99f-5b05-4494-b8b5-33537bb05a03 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.861025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.861826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.862141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.862425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.863069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.864432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.867900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec4e9-e71f-42b0-bb6e-dd027be665e4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.876496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.877417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:22.878286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 410/810] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.879399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.897244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:22.907033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:22.911317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:22.911317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:22.911317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:22.915850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:22.917352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:22.932096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:22.938404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 401/811] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:22.939339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:22.981963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fed7d0-3a36-4ed6-b30d-6293d1bc814d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.017424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.018132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.018413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.018697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.019520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:23.019826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.021256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.036673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3b53-eabc-4bbf-a8e0-1961d351c0b5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.038395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 411/812] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:09:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:23.039435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.044763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.071139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.072033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.072315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.072594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/1e132b21d8bb426391e00c48f22b9922/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.074669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=1e132b21d8bb426391e00c48f22b9922, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.076116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.115769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.138414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8efc6-57dc-480e-a443-228e9205225a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.144575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 402/813] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:22 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/1e132b21d8bb426391e00c48f22b9922/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:09:23.145402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.176740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.177478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.177833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.178153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.190603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.190603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:23.194106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:23.195157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:23.196612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 412/814] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:23.198173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.270075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17720-05b7-4ac5-896d-97a17040a67a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.311932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a350fb-d95c-48a0-b56d-e486d19646d5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.313083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.313827 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.314150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.314438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.315156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:23.315464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.316849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.322264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 403/815] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:23.325329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.352514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.353278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.353633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.353980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.354602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.355785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:23.356168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.357667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.368435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.377606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 413/816] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:23.378448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.436709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543b29-22da-4f42-ba1f-8e6f2e22ea42 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.473414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.474093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.474380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.474654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.497957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a064a49-2244-46f4-bd72-8571a50f907f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.532591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.533261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.533548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.533835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.534584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:23.534898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.536265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.541620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 414/817] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:23.546841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.547689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.549448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.580771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.609017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.654291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30dcce-4738-4387-9ed1-9a5c7bf8bba0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.667612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 404/818] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:09:23.668777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.697368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.698135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.698520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.698910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.699625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:23.699936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.701308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.706110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 415/819] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:23.706879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.779113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75f54-131c-4102-943e-a1d4cbcd9282 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.809852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.816447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6fc03-59f1-4eab-aff3-27927db22013 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.821917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.821917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.821917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.821917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.829292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.830820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.844470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:23.849355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:23.850329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:23.851295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:23.851295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:23.851295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:23.851295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:23.853566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:23.854258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:23.859875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 405/820] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:23.859875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.860045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:23.860045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:23.860045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] RBAC: Adding query filter params (type=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:23.860353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:23.861660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:23.866854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 416/821] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:23.867671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:23.969914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a47a-d2e7-4709-bb99-b1cf8fd9b62f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:23.975697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdbe93-b2ac-462f-a557-4e82609d444b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.008417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.009341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.009626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.009904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.010766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.011606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.011898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.012180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.012928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.014354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.020924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.022395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:24.041842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:24.043358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:24.044244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:24.044244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:24.044244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:24.044244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:24.046134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 406/822] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:24.047162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.080521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:24.120051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 417/823] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:24.131138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.150588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303ef6-9dce-4a80-9872-6bb385203175 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.197712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:24.206364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.207304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.207760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.208210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.209181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:24.209644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.211927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.225784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 407/824] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:24.227016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.337863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:24.348428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb841-4149-4ffd-9bac-23ae5da6451d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.394978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.395218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a118-78e2-40f5-8028-e0bd2795e8a5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.396101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.396541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.397092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.397960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:24.398433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.400546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.413319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 408/825] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:24.414730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.437814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.439160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.439543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.439917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.441123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.443299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.522246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5177367-a01d-4896-b4dc-db7d370f1ab1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.535769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 418/826] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:24.536952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.579999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.581927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.581927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.581927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.591820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.595670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:24.611578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:24.612763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:24.613874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:24.616013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 409/827] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:24.621803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.632793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:24.748387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304b61-fb09-41d3-a923-ddfef8dd4f36 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.778514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce268d-c989-44f3-8d5a-3fb7bb9a1aa7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.779955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:24.787660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.794725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.794725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.794725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.794725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:24.794725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.794725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.807610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 410/828] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:24.813579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.826360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.827297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.827713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.828066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:24.836418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:24.837958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:24.854270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:24.855206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:24.856106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 419/829] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:24.863413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:24.894817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:24.939585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd428a15-10d7-4685-93f7-f8dd20f666e3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:24.980515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeda8c9-e4ca-41c7-8375-ba1ed1abf064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:24.981822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeda8c9-e4ca-41c7-8375-ba1ed1abf064 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:24.982336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeda8c9-e4ca-41c7-8375-ba1ed1abf064 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:24.982769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeda8c9-e4ca-41c7-8375-ba1ed1abf064 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/868589ee9f3c4265abd3916bfa2266c0/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.000676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeda8c9-e4ca-41c7-8375-ba1ed1abf064 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=868589ee9f3c4265abd3916bfa2266c0, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:25.002389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeda8c9-e4ca-41c7-8375-ba1ed1abf064 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:25.008276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166027c-5c4c-43f9-86c6-228475c7fa08 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:25.044749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:25.045337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.045626 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.045906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.046758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:25.047069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:25.048506 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:25.062758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 420/830] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:25.068042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:25.071351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 411/831] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:24 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/868589ee9f3c4265abd3916bfa2266c0/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:09:25.098096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:25.185468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd857ac0-f69a-4699-a31c-b8d1badf3b4b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:25.223403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:25.224086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.224378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.224660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.225494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=99f73e12101d42c9b94d8b19ec555055) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:25.225811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:25.227334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0737c-ba8d-480a-8a2b-4e3afd51b7c1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:25.234278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 421/832] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:25 2022] GET /identity/v3/role_assignments?user.id=99f73e12101d42c9b94d8b19ec555055&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:25.260746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78993292-be74-4159-80b5-e1b5111f21be None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.261063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78993292-be74-4159-80b5-e1b5111f21be None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.261316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78993292-be74-4159-80b5-e1b5111f21be None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.263114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 412/833] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:25.269079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.269623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.270103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.288933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:25.290498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:25.368149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 422/834] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:25.392494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78993292-be74-4159-80b5-e1b5111f21be None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:25.513177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78993292-be74-4159-80b5-e1b5111f21be None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:25.530305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:25.548594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:25.549385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.549667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.555667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.561175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:25.568760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:25.569693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:25.570613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 413/835] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:25.576561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:25.594540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:25.679731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ef4d0-cd96-4f22-91d3-4840c0f9c98a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:25.715253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:25.716149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.716596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.717008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.717883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:25.718349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:25.719844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:25.728716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 423/836] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:25.734342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:25.836128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80290a-2ad0-41ee-a634-70f0df49f7be None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:25.874064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:25.874873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:25.875156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:25.875433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:25.886769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:25.888258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:25.906171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:25.907105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:25.907982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:25.907982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:25.907982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:25.907982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:25.907982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 414/837] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:25.914291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:25.993736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:26.015399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323512-1fcf-446b-a06d-27a147f8f26c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.050863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:26.051530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.051812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.052085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.052804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:26.053109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:26.054496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:26.067234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 424/838] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:26.073187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:26.115252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:26.186582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52f4d-4730-4e2b-a7e6-b64d0f4d1688 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.221016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:26.221802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.222112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.222392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.229577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:26.231056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:26.245953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:26.246926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:26.247865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 415/839] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:26.254805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:26.364278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf275-df43-4fa4-9ca1-2256396563df None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.400461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:26.401140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.401424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.401702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.402563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:26.402869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:26.404282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8eda19-0930-4e2d-b46b-5f774a77c626 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:26.414065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:26.429171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 425/840] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:26.435154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:26.450955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137f30-b488-4ca7-a92f-0ec9cb9da728 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.451336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137f30-b488-4ca7-a92f-0ec9cb9da728 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.451612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137f30-b488-4ca7-a92f-0ec9cb9da728 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.453220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 426/841] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:26.458295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.458584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.458863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.476090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:26.477829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:26.543030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:26.558250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c732a2-a8a9-4051-ae61-a8205ae3685b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.558414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 427/842] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:26.575202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:26.597159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:26.597807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.598120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.598397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.685631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:26.686347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cacfc9-679b-406e-ad86-4aaf5900b5de None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.687145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:26.719484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:26.729732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:26.733705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.733705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.733705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.733705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:26.733705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:26.747700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:26.749085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:26.750050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:26.752576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 428/843] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:26.757597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:26.806444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:26.821254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 416/844] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:09:26.826862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:26.908050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ce6b-410b-4ab1-bea1-5a3bdf9b2aeb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.951460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:26.952511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:26.953026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:26.953515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:26.954476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:26.955018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:26.956601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:26.960653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfb73e-7632-44bc-80eb-73eb0096c881 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:26.962454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 429/845] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:26.970459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.007610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.009020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.009306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.009584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.023257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.025120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.035931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:27.049907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:27.051026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:27.052122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:27.052122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:27.052122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:27.052122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:27.054066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 417/846] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:27.057731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.095105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebca25-0599-410d-b9d2-3ffa73190aa1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.105712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:27.146146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.147185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.147686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.148283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.149380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:27.149905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.151599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.157485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 430/847] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:27.179796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efbf2b-55a4-4342-ae23-9e6f3962f2d0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.221647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.222745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.223265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.223750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.224748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:27.225288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.227604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbc6bb-bea8-4e1b-8ac4-2fe3259798d9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.241891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 418/848] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:27.248586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.323891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736222a9-fcb2-4b08-bae2-4ab1b2237de9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.324091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736222a9-fcb2-4b08-bae2-4ab1b2237de9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.324366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736222a9-fcb2-4b08-bae2-4ab1b2237de9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.325762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 419/849] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:27.332873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.333168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.333453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.359097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:27.360303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:27.368654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739643f0-9d7b-499d-939d-bd08bd7ec25d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.387835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:27.409951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.411751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.412420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.413078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.422929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.424606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:27.440403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:27.441568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:27.442688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:27.444869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 431/850] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:27.454196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 420/851] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:27.454373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.479230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.513350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:27.567412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5e108-cb74-4a64-9948-3f603f17156a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.587964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc583-6da0-4c34-8e46-22d8f4daa48b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.604294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.604960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.605250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.605529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.606354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:27.606668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.608108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4376565-f2f4-4ac5-b3a1-ab4a6a02b024 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.621198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 432/852] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:27.624330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c6502-8c7f-4503-b74f-880973cd065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.625237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c6502-8c7f-4503-b74f-880973cd065e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.625621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c6502-8c7f-4503-b74f-880973cd065e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.626247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c6502-8c7f-4503-b74f-880973cd065e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.627117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031f45-d3e0-4643-9b9c-6e31b665761d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.627414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031f45-d3e0-4643-9b9c-6e31b665761d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.627700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031f45-d3e0-4643-9b9c-6e31b665761d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.633175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 433/853] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:27.633175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f031f45-d3e0-4643-9b9c-6e31b665761d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.642661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c6502-8c7f-4503-b74f-880973cd065e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d03c6502-8c7f-4503-b74f-880973cd065e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:27.650992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:27.652155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:09:27.653201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:27.654052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 421/854] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:27.655540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.655949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.662023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.678177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:27.679446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:27.684609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:27.748628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 422/855] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:27.751652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f031f45-d3e0-4643-9b9c-6e31b665761d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.758910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.781538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:27.795666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.796328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.796618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.796907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.797737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=1e132b21d8bb426391e00c48f22b9922) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:27.798086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.799525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.805553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 434/856] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/role_assignments?user.id=1e132b21d8bb426391e00c48f22b9922&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:27.811145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.875238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3e5d-c3e8-40df-99b3-964a2e8677d4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.922050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:27.922916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:27.923299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:27.923706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:27.924891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:27.925205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:27.927342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:27.938268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 423/857] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:27.943333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:27.956574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b54d0-5384-4bf8-92c0-b4c70649d2c4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:27.958804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.007826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.009186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.009610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.009894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.011410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.012269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:28.028103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:28.029090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:28.029974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 435/858] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:28.035333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:28.071509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.078367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ec15-a67c-49e2-90d2-babc3e6a2095 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.120953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.121751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.122090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.122483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.138632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.140899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.142313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2d4b9-21d5-4e54-a776-9d353f2549f0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:28.160208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:28.161146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:28.162074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:28.162074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:28.162074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:28.162074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:28.162074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 424/859] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:28.167573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:28.178269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.178944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.179224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.179501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.180250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:28.180557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.181933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.191341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 436/860] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:28.192623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:28.239026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.286820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3133b87-7470-41b0-b31e-647c10e60bd3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.326701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbddc2d-a8ac-492e-ab25-632a8832928d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.345501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.346865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.347320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.347746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.348634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:28.349630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.351500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.354290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.364564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:28.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.370838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 425/861] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:28.373796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:28.378602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 437/862] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:28.496762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116097-007c-496b-81e7-bf38ec1f5d08 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.534791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.535865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.536309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.536735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.545237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.547038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:28.562719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:28.563872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:28.565046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:28.567274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 426/863] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:09:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:28.573156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:28.676915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.684675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e61b-a9f2-4193-ba4b-640d4ccb4c9a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.719907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.720887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.721375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.721866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.723125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:28.723589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.725188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:28.744763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 438/864] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jun 20 12:09:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:28.751157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:28.809299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.860507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7e27a-a227-47f4-ba33-caeca6e911fe None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:28.895431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:28.896323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:28.896783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:28.897227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:28.969739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:28.971496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.030679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:29.077199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 427/865] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:09:29.082741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:29.187730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9f20-cbfe-4e72-b8c3-1d880a2c2d71 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:29.222472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:29.223269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.223556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.223840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.234772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:29.237480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d5d532ab-d0ec-48ea-be01-fd50688326f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:29.255551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:29.256634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:29.257699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:29.257699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:29.257699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:29.257699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:29.257699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 439/866] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:29.263648 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:29.344968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60d45-8e0e-43be-84b6-536ac438436b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.345153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60d45-8e0e-43be-84b6-536ac438436b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.345433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60d45-8e0e-43be-84b6-536ac438436b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.347095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 440/867] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:29.355474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.355979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.356269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.362404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:29.373182 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28130c9-3792-41c7-a4ea-d249d8ae2acc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:29.373935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:29.375248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:29.411326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:29.412344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.412875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.413282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.414988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:29.415440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:29.416943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.434224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 428/868] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:29.435291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:29.452313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:29.459224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 441/869] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:29.487763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:29.550436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945057-4a1a-4d9e-b0da-7df2c9a750d7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:29.584773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:29.585557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.585838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.586188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.593909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:29.595442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.608149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af969-01e9-45e1-85d9-3404655eda8b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:29.610168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:29.611039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:29.612094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:29.616342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 429/870] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:29.617284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:29.646446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a12d8-cbf5-4d17-8da3-694d9e538aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:29.647243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a12d8-cbf5-4d17-8da3-694d9e538aac None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.647530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a12d8-cbf5-4d17-8da3-694d9e538aac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.647809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a12d8-cbf5-4d17-8da3-694d9e538aac None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.648550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a12d8-cbf5-4d17-8da3-694d9e538aac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:29.650728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a12d8-cbf5-4d17-8da3-694d9e538aac None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.652869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:29.696692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:29.721952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07980af4-e145-49f9-b523-c033cc8214de None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:29.757799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:29.759088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.759369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.759692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.760599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:29.760913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:29.762363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.780437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 430/871] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:29.786465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 442/872] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:29 2022] POST /identity/v3/services => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:09:29.788906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:29.906918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51548-b919-41af-9ef6-55efdc154a84 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:29.938031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c5e2-7243-4d16-930b-92ba155ceae5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.938342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c5e2-7243-4d16-930b-92ba155ceae5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.938642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c5e2-7243-4d16-930b-92ba155ceae5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.940242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 443/873] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:29.946282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.946573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.953400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.953520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:29.953520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:29.955215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:29.955215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:29.955215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:29.956348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=868589ee9f3c4265abd3916bfa2266c0) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:29.956348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:29.957485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:29.965305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 431/874] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:29 2022] GET /identity/v3/role_assignments?user.id=868589ee9f3c4265abd3916bfa2266c0&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:29.972143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:29.978435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:30.056493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 444/875] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:30.079861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:30.200580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6b9a-8519-4e8f-8b2b-bca93acc92a7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:30.235890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:30.236691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:30.236970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:30.237762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:30.238509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:30.239952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:30.253213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:30.254277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:30.255132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 432/876] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:30.260748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:30.365815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c860ae-5ed4-4529-92c8-e11c5446c01b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:30.391468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:30.401856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:30.412783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:30.412783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:30.412783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:30.412783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:30.412783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:30.412783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124737a1-c35f-4c4f-8120-b9de913e4e74 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:30.413227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 445/877] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:30.419014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:30.475138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d269c-2c0e-485d-9681-f7eca7bf7dcf None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:30.475744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d269c-2c0e-485d-9681-f7eca7bf7dcf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:30.476240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d269c-2c0e-485d-9681-f7eca7bf7dcf None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:30.478619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 446/878] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:30.485792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:30.486100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:30.486378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:30.487516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:30.504765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:30.506215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:30.534750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea5f7c-36d2-4109-a310-283189c47e69 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:30.577259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:30.578141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:30.578493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:30.578840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:30.579787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:30.580157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:30.582246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30279f-11e5-4b55-84f1-81e64cd5a08e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:30.589662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 447/879] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:30.598087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 433/880] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:30.616417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:30.730104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2ffe5-0803-48b5-93c3-e72cf15d90ba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:30.749270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:30.765854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7eed2-7a97-4d73-9e3b-86ec4d4e60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:30.766553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7eed2-7a97-4d73-9e3b-86ec4d4e60b2 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:30.766838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7eed2-7a97-4d73-9e3b-86ec4d4e60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:30.767119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7eed2-7a97-4d73-9e3b-86ec4d4e60b2 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:30.767836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7eed2-7a97-4d73-9e3b-86ec4d4e60b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:30.769202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7eed2-7a97-4d73-9e3b-86ec4d4e60b2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:30.849259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 448/881] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:30 2022] POST /identity/v3/services => generated 269 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:31.931345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d84b2-fbf3-47ca-bdf7-d615b7a6ccb1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:31.931931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d84b2-fbf3-47ca-bdf7-d615b7a6ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:31.931931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d84b2-fbf3-47ca-bdf7-d615b7a6ccb1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:31.933558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 434/882] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:31.938779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:31.939171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:31.939338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:31.956403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:31.957600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:32.034143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 449/883] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:32.057737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d84b2-fbf3-47ca-bdf7-d615b7a6ccb1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.173748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d84b2-fbf3-47ca-bdf7-d615b7a6ccb1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.202431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:32.207827 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.208612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.208892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.209168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.209808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:32.211735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9dec686b-5241-427f-a5f5-d7aa14d6ec23 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:32.223382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:32.228014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:32.228847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 435/884] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:32.234229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.343897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bcf2-e15c-4d8a-a8a0-f31f5add2b05 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.344404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bcf2-e15c-4d8a-a8a0-f31f5add2b05 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.344903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bcf2-e15c-4d8a-a8a0-f31f5add2b05 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.346620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0a718-57b8-4faa-8890-dc41b094cb59 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.347593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 436/885] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:32.349773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:32.353058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a843-81de-4162-b039-07da6a17b07c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.353339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a843-81de-4162-b039-07da6a17b07c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.353608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a843-81de-4162-b039-07da6a17b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.370654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7927a843-81de-4162-b039-07da6a17b07c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:32.371946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7927a843-81de-4162-b039-07da6a17b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:32.387145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.388225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.388742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.389329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.390386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:32.390893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:32.392528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:32.404108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 450/886] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:32.409513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.454093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 437/887] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:32.471062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a843-81de-4162-b039-07da6a17b07c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.521521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ea1-34bf-4329-bd9d-fa762cf8f9f9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.559452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.560555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.561037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.561515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.562558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:32.563067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:32.564886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:32.571345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 451/888] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:32.586662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.592132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a843-81de-4162-b039-07da6a17b07c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.611781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:32.615719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:32.639084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.640486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.641062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.641484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.658873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:32.671979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:32.686696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 438/889] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:32.687546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.688634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1dd21-dd94-4fee-bd65-abe32cdcfd05 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.727984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.728611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.729247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.729529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.730664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] RBAC: Adding query filter params (interface=public, service_id=866a5266a66945daad3b89ed3b3e0bea, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:32.730986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:32.732637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd69ec-c2da-4eb8-af3b-52aa92b90990 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:32.743931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 452/890] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/endpoints?service_id=866a5266a66945daad3b89ed3b3e0bea&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:32.743931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84efbc-9dac-4e3d-ac19-f397c294f107 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.743931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84efbc-9dac-4e3d-ac19-f397c294f107 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.743931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84efbc-9dac-4e3d-ac19-f397c294f107 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.746128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 453/891] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:32.746905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84efbc-9dac-4e3d-ac19-f397c294f107 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.794190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b566-d3cc-4cad-9cd8-6f931fb2e847 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.829355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.830057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.830337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.830615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.831360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:32.831665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:32.833045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dc59b-77ff-43e3-9fe6-742001f5bc3c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:32.841982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 439/892] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:32.847357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:32.847559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.847817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.848123 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.855128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84efbc-9dac-4e3d-ac19-f397c294f107 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:32.865824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:32.867120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:32.890326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:32.890991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:32.891326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:32.891552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:32.892235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:32.893601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:32.899518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:32.910205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 454/893] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:09:32.911262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:32.957173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 440/894] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:32.985493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.043699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38365-93fc-49ea-9a8e-df8559e4ed96 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.085975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.087307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.087619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.087876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.098881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.100346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.104706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6195-a226-43e5-bb22-786ec2649843 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6583c11d-14bf-48aa-a940-9a373504e752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:33.128163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:33.129150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:33.130533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:33.130533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:33.130533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:33.130533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:33.130533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 455/895] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:33.131060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e783-efc7-4dd1-9543-7d4eea60a163 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.131344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e783-efc7-4dd1-9543-7d4eea60a163 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.131619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e783-efc7-4dd1-9543-7d4eea60a163 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.133127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 456/896] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:33.137633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e783-efc7-4dd1-9543-7d4eea60a163 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.155299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.164954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383bb9f-a5dc-4a27-9cc8-c8e992c14c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.165656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383bb9f-a5dc-4a27-9cc8-c8e992c14c39 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.174253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383bb9f-a5dc-4a27-9cc8-c8e992c14c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.174253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383bb9f-a5dc-4a27-9cc8-c8e992c14c39 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.174253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383bb9f-a5dc-4a27-9cc8-c8e992c14c39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.174253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383bb9f-a5dc-4a27-9cc8-c8e992c14c39 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.253261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e783-efc7-4dd1-9543-7d4eea60a163 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.270300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 441/897] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:32 2022] POST /identity/v3/services => generated 241 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:09:33.271990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.272462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.272942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.300807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:33.302286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:33.311545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.312694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.313399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.315061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.316051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:33.316547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.318335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.334020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 457/898] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:33.341198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.341693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.417785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 442/899] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:33.442415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.447316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.493593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710980c4-d05c-4bc7-9c37-3e758be69aea None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.545139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.545599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.546129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.546627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.557447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.558932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.570996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a24ff-af76-41b5-98d9-2cbd3e108d64 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:33.574918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:33.575845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:33.576804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 458/900] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:33.583508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.611158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.611989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.612271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.612548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.613212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.614769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:33.629721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:33.631961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:33.634572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 443/901] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:33.643289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.677511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.703436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261baa-f121-43f0-abd4-07c054bbb308 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.739586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.753159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.754738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.755271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.756245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.757599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:33.758460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.760691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.781164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca29fd-cc37-4e68-9f2e-a7a9546eef62 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.787352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 459/902] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:33.788259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.829064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.830139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.830635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.831119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.832650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:33.833214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:33.835323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:33.844983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 444/903] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:33.851301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:33.907898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5431-d171-415b-b85e-38fd435a6ab0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:33.951889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:33.952810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:33.953264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:33.953942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:33.955469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.975233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b39635-749a-4024-989c-3a21d77742d7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.026586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.027739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:34.028288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.029442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.029912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.031105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:34.031780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.033979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.041861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 445/904] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:34.046930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.048461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.051092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.186392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111a03-2cb6-4cab-8312-08f4c56572a7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.190390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 460/905] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:09:34.196321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.228864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.229862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.230381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.230961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.232100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] RBAC: Adding query filter params (interface=public, service_id=321cdf51a0d3480c82369b8134c28c6a, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:34.232717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.234478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.245394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 446/906] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/endpoints?service_id=321cdf51a0d3480c82369b8134c28c6a&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:34.246624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.264500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:34.306230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:34.325567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9c52-e594-45ad-aeb2-c07f4dfd485a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.372391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.373148 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71861f-dae7-48e8-aa8c-da884c1a9ce9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.373363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.373742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.374150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.386191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.387841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:34.407827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:34.408829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:34.409730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:34.409730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:34.409730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:34.409730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:34.412823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.413984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.414531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.414638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 461/907] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:34.415120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.415913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.416221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.417900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.425400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 447/908] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:09:34.533527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594d3ca-3c7f-43b7-b31c-df620fa37b6c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.572604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.573730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.574259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.574769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.575731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:34.576249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.577892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.586450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:34.592308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 462/909] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:34.599141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.694068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:34.716391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446877b2-76f3-4992-aefb-32c776fc16f0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.752905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.753753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.754134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.754471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.761425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.762917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:34.776934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:34.777844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:34.778783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 448/910] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:34.785491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.898020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee294f-2889-48ad-85a7-d87a650c036a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:34.932710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:34.933411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.933709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.934005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.934814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:34.935129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:34.936576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f970fa0-023f-423e-b8b9-30bfe24a5729 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:34.949904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 463/911] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:34.959167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:34.989954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c443a-daab-469f-8c6d-94e6177137c6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.990335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c443a-daab-469f-8c6d-94e6177137c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.990539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c443a-daab-469f-8c6d-94e6177137c6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:34.992035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 464/912] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:34.997320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:34.997608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:34.997890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.014640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:35.015807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:35.087575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:35.090146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62c4d3-44ab-423e-ab14-62e250c91a41 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:35.116650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 465/913] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:35.135393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:35.143900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:35.145266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.145786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.146655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.147708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] RBAC: Adding query filter params (role.id=3572b03c68264c7ab77c18ee1493a9d5, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=868589ee9f3c4265abd3916bfa2266c0) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:35.148255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:35.149939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:35.156313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 449/914] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:34 2022] GET /identity/v3/role_assignments?user.id=868589ee9f3c4265abd3916bfa2266c0&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=3572b03c68264c7ab77c18ee1493a9d5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:35.256849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b06fa-fd93-437a-861c-93091b061533 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:35.297026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:35.298249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.298770 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.299255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.300135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:35.301873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-731e4e25-5a69-4828-bd63-03436643baf0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:35.315688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:35.316734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:09:35.317579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:35.321061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 466/915] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:35.327175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:35.330365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:35.431160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4db86-c334-4e43-be71-e2524fcfdf90 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:35.470200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:35.470875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.471163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.471452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.472168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:35.472415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090876-b5cf-495d-a023-8cc52a996bb6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.472513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:35.472790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090876-b5cf-495d-a023-8cc52a996bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.473146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090876-b5cf-495d-a023-8cc52a996bb6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.473851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:35.474947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 467/916] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:35.479910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 450/917] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:35.481000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.481381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.481734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.485789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:35.506245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:35.507824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:35.572085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:35.579371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:35.618026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ea4b-ffe1-44f0-bee6-dc18449e227c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:35.618587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 468/918] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:35.638063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:35.654817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:35.655628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.655925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.656278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.657065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:35.657445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:35.659583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:35.666241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 451/919] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jun 20 12:09:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:35.672442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:35.770905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae574767-4347-4145-a79e-6109373e6b4b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:35.788128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee89aa-0b0a-4fba-af5d-78582a5eecdc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:35.815705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:35.816514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.817187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.817471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.818174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:35.819959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:35.820952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:35.826509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:35.827457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:35.827944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:35.828388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:35.829292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:35.830883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:35.833687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:35.837415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:35.838581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:35.841007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 469/920] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:35.842667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:35.892240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:35.942553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 452/921] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:35.955325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688970-a31e-4b78-a661-650b8c6a05ed None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:36.004257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:36.005409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.006095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.006588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.007784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:36.008612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:36.011005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:36.017382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 470/922] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:36.024174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:36.152587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f4faf-bd1e-4e9e-be31-0a58cf79f35e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:36.188820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:36.189491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.189774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.190079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.190796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:36.191176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:36.192558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:36.200700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 453/923] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:36.206428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:36.315577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520162fa-8d5f-4b98-83a2-73cff79e2745 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:36.322879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:36.350631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:36.351326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.352149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.352449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.353482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] RBAC: Adding query filter params (interface=public, service_id=b2286dcabbd04b84bcad89d459c02ec5, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:36.353973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:36.355439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150721cf-34cb-423e-b9c6-8072f81be3b8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:36.361392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 471/924] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:36 2022] GET /identity/v3/endpoints?service_id=b2286dcabbd04b84bcad89d459c02ec5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:36.368133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:36.420756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:36.472771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223cb12-0c2d-4c53-99b1-858021ca6972 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:36.509513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0a4a-6253-4675-ba64-da848186c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:36.510540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0a4a-6253-4675-ba64-da848186c041 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.511024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0a4a-6253-4675-ba64-da848186c041 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.511523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0a4a-6253-4675-ba64-da848186c041 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.512397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae0a4a-6253-4675-ba64-da848186c041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:36.514056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae0a4a-6253-4675-ba64-da848186c041 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:36.520860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 454/925] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:36 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:09:36.710806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bd13d-267e-4f62-a986-80deaf73b0d6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.711633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bd13d-267e-4f62-a986-80deaf73b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.711918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bd13d-267e-4f62-a986-80deaf73b0d6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.713560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 472/926] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:36.718856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.719151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.719433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.737025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:36.738248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:36.809814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 455/927] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:36.833681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bd13d-267e-4f62-a986-80deaf73b0d6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:36.956016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bd13d-267e-4f62-a986-80deaf73b0d6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:36.991590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:36.992410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:36.992695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:36.992977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:36.993689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:36.995166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:37.008518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:37.009462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:37.010728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 473/928] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jun 20 12:09:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:37.016022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:37.066393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:37.128282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50afe8-d6b9-45ca-b1a1-486e4fe0c7d4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:37.164427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:37.165156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.165366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.165645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.166382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:37.166696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:37.168077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad21e-6748-4b1b-aa1f-bcd759aa4fae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:37.173271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 456/929] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:37.178936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:37.197700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252a414-5c99-4fa1-bfdb-de6b05803871 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.198028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252a414-5c99-4fa1-bfdb-de6b05803871 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.198301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252a414-5c99-4fa1-bfdb-de6b05803871 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.199997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 457/930] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:37.204820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.205107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.205390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.222337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:37.223139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:37.224351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:37.300188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e198-1847-4257-8ebd-d84c68d543be None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:37.322084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 458/931] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:37.337473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:37.337759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:37.338173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.338460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.338747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.339460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:37.339933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:37.341436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:37.347186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 474/932] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:37.353013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:37.390214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:37.461286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6480-ff71-48d7-bbe3-e9e682f79000 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:37.462638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:37.466656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80852790-50cc-42f9-9dd9-454511dc928f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:37.497762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:37.499155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.499899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.500553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.504627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:37.505404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.505758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.506161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.506969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:37.509326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:37.512252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:37.522509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:37.523505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:37.524358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 459/933] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jun 20 12:09:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:37.529614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:37.610826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 475/934] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:09:37.653401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:37.657857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619939-19e5-4589-b456-f718298f82a2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:37.703865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:37.704549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.704833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.705110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.705885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:37.706292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:37.707818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:37.719017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 460/935] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:09:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:37.726173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:37.843018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb87a67-31ba-43eb-ae82-eef02a30b71d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:37.878400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:37.879130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:37.879470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:37.879864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:37.891594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:37.893072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:37.916749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:37.921876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:37.922936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:37.922936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:37.922936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:37.922936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:37.922936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 476/936] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:37.926330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.052026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acf742-4b16-4745-84cb-a99ffc41823b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.088282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.088949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.089234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.089519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.090277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:38.090587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.092028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39d325-4d25-4143-8dbd-7c253313466c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.104513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 461/937] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:38.111784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.131260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.233649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55457d-aa4b-4518-9726-41674fd0c68d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.241902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a6ab-ba5a-476b-8b6d-6612216a60cd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.242428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a6ab-ba5a-476b-8b6d-6612216a60cd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.242506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a6ab-ba5a-476b-8b6d-6612216a60cd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.244022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 462/938] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:38.251420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.252366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.252862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.274205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.274910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:38.275412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.275836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.276251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.277108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:38.288331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.291769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.306404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:38.311148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:38.312095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:38.313047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:38.314795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 477/939] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:38.322989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.374197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 463/940] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:38.392212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.400417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.438054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7bfa6-18cc-40bd-8ae2-540c69cfebe7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.474949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.475683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.476138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.476312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.477249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:38.477461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.478912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.499268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec0ce7-b34e-496a-b525-a8f559f1979f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.502444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 478/941] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:38.503371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.537102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.538214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.538711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.539493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.540532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.542270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.543867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING keystone.server.flask.common [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 12:09:38.607822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77a81-94d2-4fee-ad0b-c36553bccb88 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.612266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 12:09:38.612266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 12:09:38.612266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [parameters: {'id': 'c427ce294ace45239ce51c052d5faab7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 12:09:38.612266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c427ce294ace45239ce51c052d5faab7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c427ce294ace45239ce51c052d5faab7. Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:09:38.620251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 12:09:38.621061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jun 20 12:09:38.622031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:09:38.622940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 12:09:38.623846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:09:38.624646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'id': 'c427ce294ace45239ce51c052d5faab7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.625693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:38.626577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c427ce294ace45239ce51c052d5faab7. Jun 20 12:09:38.627671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.636396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 464/942] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Jun 20 12:09:38 2022] POST /identity/v3/projects => generated 262 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:38.636651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.638171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.641587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.649437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.653327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.653327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.653327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.662673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.664434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d4b5945d-6c52-457f-b379-5dabd7a833bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:38.690613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:38.691539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:38.692587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:38.692587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:38.692587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:38.692587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:38.694251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 479/943] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:38.700663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400f1d-bf5f-41de-9b08-fb8d09c0b212 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.700956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400f1d-bf5f-41de-9b08-fb8d09c0b212 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.701237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400f1d-bf5f-41de-9b08-fb8d09c0b212 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.702693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 480/944] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:38.703378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9400f1d-bf5f-41de-9b08-fb8d09c0b212 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.755729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695271b-6cca-48ad-afa0-020ec30641ea None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.792594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939809be-3089-455a-adba-f81755c324af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.793391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939809be-3089-455a-adba-f81755c324af None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.793677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939809be-3089-455a-adba-f81755c324af None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.793974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939809be-3089-455a-adba-f81755c324af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.800730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939809be-3089-455a-adba-f81755c324af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.802444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939809be-3089-455a-adba-f81755c324af None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-939809be-3089-455a-adba-f81755c324af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:38.816697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:38.817597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:38.818536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 465/945] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:38.819488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.819488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.819744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.824520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9400f1d-bf5f-41de-9b08-fb8d09c0b212 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:38.839625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:38.841249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:38.864043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:38.864703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:38.864989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:38.865536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:38.866006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:38.866325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:38.868220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:38.879601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 481/946] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:38.880311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.911140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.917745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:38.922375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 466/947] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:38.923021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:38.996834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218551a-d02a-4ef4-adcd-8916ef9041ad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.028059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fe83c-63d0-4192-9082-35efcda083d0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.033295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.033959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.034278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.034561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.035715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:39.036033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.037871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.056148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 482/948] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:39.056148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.075198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.076123 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.076577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.076858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.084857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.086553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:39.107698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:39.108661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:39.109555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:39.117931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 467/949] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:39.117931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.187538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:39.193745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:39.198755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342416-b9c1-4cef-8aaa-f46e23d0c5ca None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.252656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.252656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.252656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.252656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.253537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.253609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.253922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca186-9335-48c8-a4c8-33b2b6947582 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:39.268767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:39.269832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:39.270932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 483/950] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:39.276568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.301981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.302690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.302979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.303262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.304041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:39.304355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.306413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.328347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 468/951] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:39.333882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.401310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d48f-a7bd-43c8-b362-8992eab2bd42 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.441805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.442760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.443197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.443648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.444513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:39.444996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.447104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.452700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 484/952] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:39.456321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5048-6422-447c-b6a3-4164cd20769f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.459106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.473855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:39.496235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.497304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.497618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.497969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/868589ee9f3c4265abd3916bfa2266c0/roles/3572b03c68264c7ab77c18ee1493a9d5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.500342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=868589ee9f3c4265abd3916bfa2266c0, role_id=3572b03c68264c7ab77c18ee1493a9d5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.501865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.506629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:39.576322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c69ed0-a939-4aee-8ad1-7340c9b6c7f0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.603153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 469/953] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:39 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/868589ee9f3c4265abd3916bfa2266c0/roles/3572b03c68264c7ab77c18ee1493a9d5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:09:39.621265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.622491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.624012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.624508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.625545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:39.626126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.627844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1aba6-dfd6-4591-b88a-2f87405b4292 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.636268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 485/954] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:39.642802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.763764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9b0f4-3db7-454b-b266-5ab0da51427a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:39.776142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54423c5-5e18-4750-a5a5-f0f8e2752e9e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.776797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54423c5-5e18-4750-a5a5-f0f8e2752e9e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.777183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54423c5-5e18-4750-a5a5-f0f8e2752e9e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.779886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 486/955] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:39.785446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.785854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.786267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.807745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:39.808937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:39.813456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:39.814170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:39.814457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:39.814736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:39.815493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:39.816883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:39.888026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 487/956] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:39.910183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:39.931053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 470/957] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:39.940203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:40.028648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6841320-6365-4b9e-add1-f018c7c38165 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:40.073980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:40.074973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:40.075363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:40.075743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:40.076503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:40.078021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:40.090951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:40.092293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:40.093352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:40.095457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 488/958] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:40.101355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:40.142332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:40.214668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc277-ba23-43d8-b479-fa77c72d077e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:40.255197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:40.256589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:40.257034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:40.257485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:40.258910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:40.259562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:40.261343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0aa5-4c34-492c-909c-fe71c46ea1cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:40.267380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 471/959] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:40.278049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:40.357925 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:40.379604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda0b32-b393-47a4-9389-9dfb641b73c6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:40.415913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:40.416587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:40.416873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:40.417158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:40.417862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:40.418200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:40.419566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395901-ff7e-4671-8c90-722f01c6a467 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:40.424542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 489/960] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:41.248489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e9f6-df07-4769-83e4-6b61f0859468 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.248850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e9f6-df07-4769-83e4-6b61f0859468 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.249055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e9f6-df07-4769-83e4-6b61f0859468 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.250755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 472/961] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:41.256086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.256374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.256654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.273872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:41.275137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:41.346107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 490/962] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:41.366212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e9f6-df07-4769-83e4-6b61f0859468 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:41.474410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:41.482025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e9f6-df07-4769-83e4-6b61f0859468 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:41.516927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:41.517827 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.518312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.518737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.519585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:41.521197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:41.564015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 12:09:41.564015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 12:09:41.564015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [parameters: {'user_id': '106897dbd1094bfeb20cf824f5df718d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 12:09:41.564015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e6f88ae5-3fad-43e7-a1a9-b9837c1aa16e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 20 12:09:41.572467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:09:41.573533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 12:09:41.574835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:09:41.576001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:09:41.577176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:09:41.578266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'user_id': '106897dbd1094bfeb20cf824f5df718d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:41.579201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 12:09:41.580153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 12:09:41.581047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 12:09:41.581047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 12:09:41.581047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 12:09:41.581047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 12:09:41.581047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 12:09:41.581047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:41.583264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 473/963] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jun 20 12:09:41 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:41.588960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:41.669273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:41.699825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bb40-c3c0-4d68-ac4a-ccd50a487f39 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:41.736096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:41.736899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.737181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.737461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.741160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9235-22fc-4cfc-b254-73de2bb01246 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.741458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9235-22fc-4cfc-b254-73de2bb01246 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.741743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9235-22fc-4cfc-b254-73de2bb01246 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.745470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:41.746946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:41.750072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 474/964] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:41.752050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.752340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.752623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:41.762901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:41.763883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:41.764833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 491/965] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:41.770997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:41.772179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:41.774502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:41.854468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 475/966] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:41.883601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:41.892749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55bfaa-b239-4c03-936b-e09651fc15a0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:41.927675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:41.937054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:41.937747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:41.938173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:41.938706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:41.939957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:41.940438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:41.941894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:41.980877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:41.994233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 492/967] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jun 20 12:09:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:42.005111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8af4-844c-4564-899d-bd574e78e664 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.043660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.044499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.044788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.045070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.057970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:42.066616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:42.067621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:42.068667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 476/968] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jun 20 12:09:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:42.074700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.188010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f07f0-f2e4-4d9b-821f-00b7c38d3024 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.226082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.227309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.227596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.227876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.228640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:42.228952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.230348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae00ddf-1652-4711-96cd-cbc7b9c2305f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.239424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 493/969] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:42.244843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.251453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45510c64-baf3-4005-a9b9-f3f08419cb67 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.251754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45510c64-baf3-4005-a9b9-f3f08419cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.252036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45510c64-baf3-4005-a9b9-f3f08419cb67 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.253652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 494/970] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:42.259315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.259599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.259877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.277469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:42.278677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:42.332494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:42.353685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 495/971] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:42.359500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606919b-b7df-47ff-b02e-41ff81f7e666 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.376992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.397197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.399302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.399739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.400162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.412154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.414279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.417101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:42.433421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:42.440121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:42.441081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:42.441081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:42.441081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:42.441081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:42.441081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 477/972] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:42.441081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.480673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cda6f-b285-474e-91df-bf06f5f3c891 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.515689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.516529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.516817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.517097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.517753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.519172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f3931a5f-d5db-4a05-b9d9-fdd210bd4d4e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:42.531854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:42.532988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:42.533866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 496/973] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:42.534722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38e57b-328a-41e6-902e-c44b711f4e08 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.534722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38e57b-328a-41e6-902e-c44b711f4e08 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.534856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38e57b-328a-41e6-902e-c44b711f4e08 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.536206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 497/974] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:42.539937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38e57b-328a-41e6-902e-c44b711f4e08 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.548577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc7bd-f2e9-4a7f-b04c-a294788a4841 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.581819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.582509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.582803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.583108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.583829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:42.584144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.585523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834443-b67a-4223-85df-eb3dd186f9bc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.586947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:42.597968 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 478/975] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:42.599230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.599521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.599809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.616109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:42.617307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:42.639838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38e57b-328a-41e6-902e-c44b711f4e08 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.667844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:42.673695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.679160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.679160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.679160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.679160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:42.679160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.679160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.682064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 498/976] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:42.682741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.688834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 479/977] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:42.689540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.780803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123afe66-f674-47e4-aab8-b4aea62a2ced None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.791223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b4173-46f3-4c8f-8146-1a45f155cce0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.791623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:42.814374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.817026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.817317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.817622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.825480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.826964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.829038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.829700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.829980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.830291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.830989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:42.831357 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.832716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.838212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 480/978] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:42.838969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:42.843759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:42.844767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 499/979] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:42.845720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:42.889869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:42.940175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408196b2-24d3-4f24-88ee-41e6c7961b71 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.948448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327478-0337-4714-8b55-fd3913f60b38 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:42.974694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.975351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.975635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.975924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.977136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.978561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.982209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:42.982867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:42.983158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:42.983439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:42.986676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] RBAC: Adding query filter params (interface=admin, service_id=b2286dcabbd04b84bcad89d459c02ec5, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:42.986676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:42.986676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:42.990872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 500/980] 10.222.0.70 () {56 vars in 1249 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/endpoints?service_id=b2286dcabbd04b84bcad89d459c02ec5&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:42.991638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:43.024209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:43.090514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 481/981] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:42 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:43.090514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:43.090762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616fb3-649e-4128-9f34-68105f704a28 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:43.134835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:43.135221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:43.135507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:43.135786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:43.136687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:43.137004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:43.139254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:43.175661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 501/982] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jun 20 12:09:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:43.176967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:43.248886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459193f-8a4f-4e66-9cf1-d4620a923dc6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:43.261574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:43.289904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:43.290750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:43.291137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:43.291636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:43.292144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:43.292422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:43.294113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:43.306089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 482/983] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:43 2022] GET /identity/v3/services => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:09:43.309792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febca3f-e13b-4c15-8b16-479ba5534f97 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:43.349724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:43.350448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:43.350808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:43.351163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:43.427372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:43.428956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:43.522507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:43.540520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 502/984] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:09:43.545959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:43.649797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f09a9-7f88-4d6c-bb70-07c64e890346 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:43.694578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:43.700038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:43.700038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:43.700038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:43.711953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:43.713430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:43.731509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:43.732521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:43.733424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:43.733424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:43.733424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:43.733424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:43.737691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 483/985] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:43.738751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:43.842363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374090d3-a451-4542-9221-59d4b5b75a7b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:43.876481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:43.877152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:43.877437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:43.877714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:43.878466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:43.878774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:43.880136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:43.892066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 503/986] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:43.897429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:43.926488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:44.003484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdebea-52e7-4135-b3a4-6647ef875e8b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:44.038511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:44.040108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:44.040365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:44.040641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:44.047281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:44.048734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:44.062693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:44.063581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:44.064491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:44.066153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 484/987] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:44.069654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:44.122126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:44.172680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecbc90-1ce2-4ef4-86d1-93e82e7cab2f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:44.206723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:44.207313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:44.207603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:44.207885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:44.208673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:44.208992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:44.210563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2982e1-b15a-4298-aed5-bff798ae05f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:44.225874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 504/988] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:44.231816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:44.322419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:44.337424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4e736-c7a3-49ab-9d64-c5d3b506841e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:44.372155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:44.372807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:44.373094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:44.373535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:44.374395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] RBAC: Adding query filter params (role.id=3572b03c68264c7ab77c18ee1493a9d5, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=868589ee9f3c4265abd3916bfa2266c0) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:44.374713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:44.376159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7c8b-6f40-44cf-81bc-41d326e7cdbb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:44.390036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 485/989] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:44 2022] GET /identity/v3/role_assignments?user.id=868589ee9f3c4265abd3916bfa2266c0&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=3572b03c68264c7ab77c18ee1493a9d5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:45.147600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce512-f066-4222-881f-14c3e74841c7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.148097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce512-f066-4222-881f-14c3e74841c7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.148201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce512-f066-4222-881f-14c3e74841c7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.150236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 505/990] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:45.155238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040d23-774f-4ede-ba35-a1ff78e35158 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.155677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040d23-774f-4ede-ba35-a1ff78e35158 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.155856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040d23-774f-4ede-ba35-a1ff78e35158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.173159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7c040d23-774f-4ede-ba35-a1ff78e35158 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:45.174411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7c040d23-774f-4ede-ba35-a1ff78e35158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:45.242928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 486/991] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:45.266126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce512-f066-4222-881f-14c3e74841c7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.369488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce512-f066-4222-881f-14c3e74841c7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:45.378373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:45.385427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e2f4-dd9f-46a8-997d-cb918ef2e799 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.385725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e2f4-dd9f-46a8-997d-cb918ef2e799 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.386031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e2f4-dd9f-46a8-997d-cb918ef2e799 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.387434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 487/992] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:45.392324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.392616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.392902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.404261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:45.405065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.405349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.405628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.406311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:45.407681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:45.410860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:45.412056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:45.420562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:45.421560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:45.422435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:45.426320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 506/993] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:45.427601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.487972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 488/994] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:45.512443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.525585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:45.536113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78108b-33ce-4acb-98ad-f3a25839826c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:45.576497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:45.577172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.577462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.577746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.578489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:45.578802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:45.580302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:45.591191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 507/995] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:45.593111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.617586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcedef-481e-4822-b88a-3dd443e75f1e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:45.638083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:45.653684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:45.654516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.654799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.655078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.655725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:45.657120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:45.670293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:45.671526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:09:45.672598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:45.675091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 489/996] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:45.681250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.720353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20d07b-08ac-43cb-aa25-17d9cbfc65ec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:45.760709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:45.761380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.761669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.761952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.762737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:45.763056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:45.764402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:45.764825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:45.771117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 508/997] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:45.778704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.794944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be49028-7f03-49cf-a984-9861548c20b6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:45.833232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:45.833896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.834212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.834576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.835196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:45.835504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:45.837054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:45.842127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 490/998] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:45.847612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.893054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:45.896024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1248-278d-46af-ad83-d17532ddfe17 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:45.936203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:45.936864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:45.937150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:45.937428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:45.938256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] RBAC: Adding query filter params (interface=public, service_id=ad68afbe3a5149c1bbef6e9b398ed93e, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:45.938577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:45.939984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:45.950029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 509/999] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/endpoints?service_id=ad68afbe3a5149c1bbef6e9b398ed93e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:45.951094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:45.972961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bec65-6574-4495-9403-e91fa4c640aa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:46.013562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:46.014323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.014616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.015112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.015597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:46.015902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:46.017281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:46.022948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 491/1000] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:46.028823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:46.031682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:46.060003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7bbf-20b6-4a27-aec1-c47c436e038e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:46.105125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9453-0980-4d3a-b34b-edf1ec2cf4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:46.105806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9453-0980-4d3a-b34b-edf1ec2cf4cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.106139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9453-0980-4d3a-b34b-edf1ec2cf4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.106506 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9453-0980-4d3a-b34b-edf1ec2cf4cd None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.107394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb9453-0980-4d3a-b34b-edf1ec2cf4cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:46.108492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb9453-0980-4d3a-b34b-edf1ec2cf4cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:46.118821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 510/1001] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:45 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:09:46.158050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed81c6-bdc8-4620-b840-4fcc7b7cd7a5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:46.196548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff6dd7-7423-4673-94a4-5489d9056ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:46.197222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff6dd7-7423-4673-94a4-5489d9056ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.197505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff6dd7-7423-4673-94a4-5489d9056ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.197787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff6dd7-7423-4673-94a4-5489d9056ae9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.198626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff6dd7-7423-4673-94a4-5489d9056ae9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:46.200081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff6dd7-7423-4673-94a4-5489d9056ae9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:46.283340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 492/1002] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:46.444484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e80-78f5-4d1c-873e-e9e041e1020b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.444970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e80-78f5-4d1c-873e-e9e041e1020b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.444970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e80-78f5-4d1c-873e-e9e041e1020b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.447088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 511/1003] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:46.452253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.452550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.452831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.469895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:46.471110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:46.530794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:46.547837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 493/1004] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:46.571197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e80-78f5-4d1c-873e-e9e041e1020b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:46.602778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:46.678285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e80-78f5-4d1c-873e-e9e041e1020b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:46.711941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:46.712648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.712930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.713202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] PATH_INFO: `/v3/services/image` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.713840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:46.715226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:46.727308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:46.736786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:46.738901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 512/1005] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jun 20 12:09:46 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:46.740976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:46.840046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8984e59-a9f4-4b20-adf5-83b229104c7c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:46.874754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:46.875419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:46.875703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:46.875980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:46.876685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] RBAC: Adding query filter params (name=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:46.876996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:46.878411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e8699-87bf-40d8-898a-35982ce9bcdb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:46.888024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 494/1006] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:46.889218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:46.983583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:46.993223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6979b-7e43-4c90-83ad-122e3ebb0221 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:47.026870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:47.027541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:47.027831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:47.028178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:47.028890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] RBAC: Adding query filter params (type=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:47.029256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:47.030802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebdc02-5c46-4a02-b61d-c4d0d55d3b6b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:47.040346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 513/1007] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:48.203726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa6dcc-05db-44d0-8c21-a3cb771c0f3e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.204241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa6dcc-05db-44d0-8c21-a3cb771c0f3e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.204241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa6dcc-05db-44d0-8c21-a3cb771c0f3e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.205777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 495/1008] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:48.210822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbeafb-2bc0-43d3-b99f-8feebc51dd20 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.211200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbeafb-2bc0-43d3-b99f-8feebc51dd20 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.211386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbeafb-2bc0-43d3-b99f-8feebc51dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.228211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f1cbeafb-2bc0-43d3-b99f-8feebc51dd20 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:48.229372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f1cbeafb-2bc0-43d3-b99f-8feebc51dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:48.297066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 514/1009] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:48.319790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa6dcc-05db-44d0-8c21-a3cb771c0f3e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:48.348534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3a8e-ccea-4c34-86bc-dffddc25b790 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.348834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3a8e-ccea-4c34-86bc-dffddc25b790 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.349117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3a8e-ccea-4c34-86bc-dffddc25b790 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.350734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 515/1010] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:48.356191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.356490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.357537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.375874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:48.376838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:48.377830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:48.426205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa6dcc-05db-44d0-8c21-a3cb771c0f3e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:48.450209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 516/1011] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:48.461141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:48.461931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.462248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.462527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.463181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:48.464552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:48.472945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:48.476916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:48.477920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:48.479038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 496/1012] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:48.484099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:48.494915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:48.580384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008831bd-c9ee-41c0-9e33-9aaeff738690 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:48.587523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57298f86-af46-45f3-9a0a-e2d469dff613 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:48.605240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:48.619443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:48.620235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.620516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.620792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.621946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:48.623017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:48.623405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:48.623685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.623970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.624246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.625168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:48.625272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 517/1013] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:48.625344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:48.626698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:48.630667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:48.636317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 497/1014] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:48.637246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:48.719948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:48.736495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7da20-5c13-483d-9d39-9d8dc3f7cfb8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:48.745131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397304-4b06-4a30-8ca0-8209dc582b67 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:48.775873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942ca2f-0997-4334-a980-ffb320141c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:48.776540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942ca2f-0997-4334-a980-ffb320141c1c None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.776830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942ca2f-0997-4334-a980-ffb320141c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.777112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942ca2f-0997-4334-a980-ffb320141c1c None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.777819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942ca2f-0997-4334-a980-ffb320141c1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:48.779283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942ca2f-0997-4334-a980-ffb320141c1c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:48.781363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:48.782033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.782322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.782624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.783464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:48.783570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:48.784933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:48.790926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 498/1015] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jun 20 12:09:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:48.796584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:48.840842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:48.879920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 518/1016] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:48 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:09:48.894004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0698d-da97-403e-b12f-98da47226f37 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:48.933341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:48.934060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:48.934356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:48.934727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:48.935398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:48.936835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:49.055714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1b05-9baa-4a56-922f-6afe84153282 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:49.056006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1b05-9baa-4a56-922f-6afe84153282 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:49.056290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1b05-9baa-4a56-922f-6afe84153282 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:49.057712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 519/1017] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:49.062387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c074ee-770b-4d40-814a-268aac85454c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:49.062678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c074ee-770b-4d40-814a-268aac85454c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:49.062962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c074ee-770b-4d40-814a-268aac85454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:49.080701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-91c074ee-770b-4d40-814a-268aac85454c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:49.081880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91c074ee-770b-4d40-814a-268aac85454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:49.094936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 499/1018] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:09:49.178024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 520/1019] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:49.196366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:49.303329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:49.307170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3e9c2-2751-424a-81df-a2e8b6516637 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:49.341983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ace3a-1046-4fd7-916a-284c59a5b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:49.342698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ace3a-1046-4fd7-916a-284c59a5b4f3 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:49.342984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ace3a-1046-4fd7-916a-284c59a5b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:49.343258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ace3a-1046-4fd7-916a-284c59a5b4f3 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:49.343975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ace3a-1046-4fd7-916a-284c59a5b4f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:49.345353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ace3a-1046-4fd7-916a-284c59a5b4f3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:49.434171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 500/1020] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:09:49 2022] POST /identity/v3/services => generated 242 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:50.951495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878916a4-2321-4732-af60-3779af7e99eb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:50.952015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878916a4-2321-4732-af60-3779af7e99eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:50.952093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878916a4-2321-4732-af60-3779af7e99eb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:50.953550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 521/1021] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:50.958717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:50.959096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:50.959270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:50.976092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:50.977306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:51.051468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 501/1022] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:51.076755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878916a4-2321-4732-af60-3779af7e99eb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.143551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.183347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878916a4-2321-4732-af60-3779af7e99eb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.217492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e00c6-3dbf-4f98-8246-5b51cc051069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.218227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e00c6-3dbf-4f98-8246-5b51cc051069 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.218516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e00c6-3dbf-4f98-8246-5b51cc051069 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.218792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e00c6-3dbf-4f98-8246-5b51cc051069 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.219969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e00c6-3dbf-4f98-8246-5b51cc051069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:51.221411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e00c6-3dbf-4f98-8246-5b51cc051069 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:51.223273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 522/1023] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:51.229281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.232889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301b33-6f6a-4777-99ed-b7e8f42c135a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.233175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301b33-6f6a-4777-99ed-b7e8f42c135a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.233456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301b33-6f6a-4777-99ed-b7e8f42c135a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.234940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 523/1024] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:51.239859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.240311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.240595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.257530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:51.258747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:51.321352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.333523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 524/1025] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:51.336835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24b393-ab4e-41bc-8f2d-b63e66093954 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.357596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.372294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503a165-b7b9-4d49-8fd5-8346667a4f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.372964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a165-b7b9-4d49-8fd5-8346667a4f36 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.373240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a165-b7b9-4d49-8fd5-8346667a4f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.373704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a165-b7b9-4d49-8fd5-8346667a4f36 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.374263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503a165-b7b9-4d49-8fd5-8346667a4f36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:51.375763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503a165-b7b9-4d49-8fd5-8346667a4f36 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:51.418496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.458478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd2b1-3950-4038-9d2d-54d5d38d2bd1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.494783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 502/1026] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:09:51 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:51.496142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396069ee-a96d-4a40-93ff-f4f53965ddda None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.496489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396069ee-a96d-4a40-93ff-f4f53965ddda None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.496766 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396069ee-a96d-4a40-93ff-f4f53965ddda None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.502060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 503/1027] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:51.503844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.504135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.504461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.509882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.512587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.512892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.513182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.525270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:51.526660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:51.527028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:51.535414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:51.536753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:51.537630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 525/1028] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:51.543070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.610041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 504/1029] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:51.631275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.657139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71864a61-f676-4283-b8b7-7bd35b7af222 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.680336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.697675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.710164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.710164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.710164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.710164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:51.710164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:51.710164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:51.710591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.710708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 526/1030] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:51.715117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.747624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5053c-8346-4c95-b609-524c30317b05 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.795911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.796737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.797029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.797307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] PATH_INFO: `/v3/services/image` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.797973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:51.799430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:51.814180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:51.815254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:51.816103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 505/1031] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:51.824830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.839979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40486c7-a7ca-45cb-b787-8fa9d848393b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.876027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.877169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.877465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.877752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.890538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:51.892002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:51.909301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:51.910366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:51.911315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:51.911315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:51.911315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:51.911315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:51.911315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 527/1032] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:51.916594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:51.937734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371029d-b7dc-4c9e-b2d5-17aff8cebd2a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:51.955126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.973574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:51.974272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:51.974555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:51.974836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:51.975537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] RBAC: Adding query filter params (name=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:51.975848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:51.977784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:51.979708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.983353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 506/1033] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:51.988825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.026885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4c6f1-e4c8-4fc9-a061-38f180a1b694 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.063469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.064260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.064530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.064811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.065646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:52.065959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.067404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.084533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 528/1034] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:52.085537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.102888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7662c-3f2b-466f-b584-2da77c1ac304 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.144850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.145525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.145813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.146136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.146830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] RBAC: Adding query filter params (type=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:52.147141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.148817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.153836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 507/1035] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:52.159833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.189487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.196323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2bc0-0a61-430d-a1a1-ba21c6c7708a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.226120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.233258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.234134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.234434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.234697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.242883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.244395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:52.259349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:52.260347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:52.261351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 529/1036] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:09:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:52.266460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.268577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145124-a9a7-4b43-a5b8-603d5fe4e50b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.304109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.305237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.305540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.305804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.306624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] RBAC: Adding query filter params (interface=public, service_id=715c69351b3f4f5989e910fee6dcb6bc, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:52.306940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.308320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.313686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 508/1037] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:09:52 2022] GET /identity/v3/endpoints?service_id=715c69351b3f4f5989e910fee6dcb6bc&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:52.319401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.385068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7c8ff-ee3a-4e46-aba2-e229f48c5c77 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.421837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.422620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.422975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.423235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.424114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:52.424429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.425311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d3132-1d2d-4137-8db7-621c8c28df18 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.425865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.531176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 530/1038] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:09:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:52.536677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.548954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.551764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.557329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.557939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.558257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.558540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.559229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.560662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.567251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 509/1039] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:09:52 2022] GET /identity/v3/services => generated 1957 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:09:52.642104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417bc80-1a3f-4c3d-9647-9ca6fcbe674c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.680598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:52.681585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:52.682118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:52.682576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:52.757374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:52.759414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:52.773033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.859054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 531/1040] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:09:52.864860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:52.965642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffb98-281d-4ded-826e-8ce270391fe7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:52.998554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:53.000033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.000523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.001038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.012222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:53.013883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:53.031564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:53.032583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:53.033478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:53.033478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:53.033478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:53.033478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:53.033478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 510/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:53.039405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:53.146320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0e63-f9fd-463b-bbf5-89a7643ac81f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:53.159561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:53.181066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:53.181737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.182049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.182338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.183072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:53.183387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:53.184766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:53.197531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 532/1042] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:53.203033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:53.252029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:53.307379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330331fa-a433-4295-8a43-c7aecbfd465b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:53.342281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:53.343074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.343361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.343642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.350270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:53.351758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:53.365786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:53.367350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:53.368247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:53.370312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 511/1043] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:53.373157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:53.476111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67c977-22b8-4f0e-a46d-8cb996e22f91 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:53.510178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:53.510889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.511172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.511462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.512273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:53.512588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:53.514047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c2ec8-8ca4-444a-ae4f-18d050031d05 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:53.530774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 533/1044] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:53.531988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:53.615950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a856a-79e8-45f6-a5f8-d388fa70f0ca None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.616153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a856a-79e8-45f6-a5f8-d388fa70f0ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.616425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a856a-79e8-45f6-a5f8-d388fa70f0ca None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.618516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 534/1045] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:53.623512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.623812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.624099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.634567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aac34-8ee4-48dc-a235-c630e23622c5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:53.637798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:53.640658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:53.641854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:53.670192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:53.671315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:53.671969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.672358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.672607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.673332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] RBAC: Adding query filter params (role.id=3572b03c68264c7ab77c18ee1493a9d5, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=99f73e12101d42c9b94d8b19ec555055) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:53.673732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:53.675108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:53.681809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 512/1046] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:53 2022] GET /identity/v3/role_assignments?user.id=99f73e12101d42c9b94d8b19ec555055&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=3572b03c68264c7ab77c18ee1493a9d5 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:53.718997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 535/1047] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:53.743717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:53.867208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a57b-f1bb-4e84-8201-93a3976e48ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:53.913894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:53.915501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:53.915778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:53.922176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:53.926369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:53.933936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:53.935104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:53.936144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:53.938056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 513/1048] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:53.941507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:54.048959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0868f4f-4d64-4862-9129-2483e4a3be31 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:54.082269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:54.082943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.083230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.083511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.084263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:54.084575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:54.086508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:54.099284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 536/1049] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:54.100961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:54.135510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:54.214941 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029abd-b1f3-4123-a79d-c7ef28713931 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:54.259299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:54.260176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.260462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.260743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] PATH_INFO: `/v3/users/0a3f4c3f5c1848d39913a05dcf16f8c6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.274936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] RBAC: Authorizing `identity:get_user(user_id=0a3f4c3f5c1848d39913a05dcf16f8c6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:54.276389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:54.282020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 514/1050] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:09:54 2022] GET /identity/v3/users/0a3f4c3f5c1848d39913a05dcf16f8c6 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:54.283870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:54.309760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:54.386427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034afcd5-69eb-4fa4-a2a8-fed97965da70 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:54.420606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec0721-80f7-49d3-a551-50452a78121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:54.421260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0721-80f7-49d3-a551-50452a78121e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.421548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0721-80f7-49d3-a551-50452a78121e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.421836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0721-80f7-49d3-a551-50452a78121e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.489904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec0721-80f7-49d3-a551-50452a78121e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:54.491409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec0721-80f7-49d3-a551-50452a78121e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:54.516155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:54.600689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 537/1051] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:09:54.602621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:54.642423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f52e-55e8-4e34-a5b7-86b9a3f6bfb5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.642707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f52e-55e8-4e34-a5b7-86b9a3f6bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.642913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f52e-55e8-4e34-a5b7-86b9a3f6bfb5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.644454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 538/1052] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:54.649696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.649980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.650293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.668211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:54.669393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:54.691879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:54.707458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7682-909d-4ac6-bbe4-c69bd19d7b6e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:54.741689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 539/1053] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:54.744653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:54.745516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.745805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.746175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.747308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=0129b5cdd8584d76b63c4f1478f871b1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:54.748763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:54.754039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 515/1054] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:09:54 2022] GET /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:54.756334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:54.765660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:54.819124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:54.865031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ea9ec-4e5a-4f84-8733-6fa60d4fa1fd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:54.875982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b41a-9f4b-476a-8a77-81379433c8f6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:54.898784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:54.899565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.899858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.900134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.900963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=0129b5cdd8584d76b63c4f1478f871b1, user.id=0a3f4c3f5c1848d39913a05dcf16f8c6) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:54.901280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:54.902756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:54.914323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 540/1055] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:09:54 2022] GET /identity/v3/role_assignments?user.id=0a3f4c3f5c1848d39913a05dcf16f8c6&scope.project.id=0129b5cdd8584d76b63c4f1478f871b1&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:54.916356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:54.917197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:54.917486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:54.917764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] PATH_INFO: `/v3/services/image` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:54.918471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:54.919896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:54.932602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:54.933762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:54.939329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 516/1056] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jun 20 12:09:54 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:54.942817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:55.048859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fd868-a94c-4b14-bf91-a3ae58ce685c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:55.066852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:55.083830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:55.084497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:55.084783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:55.085080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:55.086399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] RBAC: Adding query filter params (name=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:55.086709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:55.088083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:55.093012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 541/1057] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:55.098886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:55.138742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:55.222367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed5209-55ae-49de-ab2a-418a766365ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:55.255932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:55.256594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:55.256891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:55.257163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:55.258413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] RBAC: Adding query filter params (type=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:55.258724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:55.260106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb1ddf-84b9-4071-a6c5-241dc05a903d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:55.269750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 517/1058] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:55.271070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:55.375943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b7758-41cb-4cea-8a3b-1633af2c2457 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:55.409858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2e6b-9f1d-443e-9219-48b012025a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:55.410561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2e6b-9f1d-443e-9219-48b012025a5a None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:55.410845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2e6b-9f1d-443e-9219-48b012025a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:55.411119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2e6b-9f1d-443e-9219-48b012025a5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:55.411860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2e6b-9f1d-443e-9219-48b012025a5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:55.413300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2e6b-9f1d-443e-9219-48b012025a5a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:55.497173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 542/1059] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:09:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:09:55.719880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabffd0-f6aa-4f4e-b0ba-a22f0e06e1c2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:55.720227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabffd0-f6aa-4f4e-b0ba-a22f0e06e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:55.720436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabffd0-f6aa-4f4e-b0ba-a22f0e06e1c2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:55.721953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 518/1060] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:09:55.727541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:55.727829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:55.728107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:55.745087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:55.746286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:55.775308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:55.823261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 543/1061] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:55.846018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabffd0-f6aa-4f4e-b0ba-a22f0e06e1c2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:55.933087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:55.952474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabffd0-f6aa-4f4e-b0ba-a22f0e06e1c2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:55.987915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:55.988720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:55.988999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:55.989270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.000266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:56.008981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:56.009952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:56.010860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 519/1062] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jun 20 12:09:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:56.016372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:56.123545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5a9f3-34b5-437b-9b33-dad292de9146 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:56.158605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:56.159278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.159563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.159842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.160583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:56.160890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:56.162281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:56.175262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 544/1063] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:09:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:56.176849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:56.280324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513237-0515-4eee-bb91-74d69d7b4923 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:56.314514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:56.315580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.316040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.316469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.327673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:56.329371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:56.331654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:56.347971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:56.353295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:56.354276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:56.354276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:56.354276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:56.354276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:56.354276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 520/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:56.355959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:56.385741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:56.458111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d7f60-caaa-4a6c-ab5d-81dbe1ce7dc3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:56.492351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:56.493028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.493315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.493592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.494344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:56.494656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:56.496024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:56.508172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 545/1065] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:56.513800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:56.622585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981101e7-ff58-45b0-affe-6b2d440ca183 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:56.658999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:56.659799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.660084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.660361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.668984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:56.670476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:09:56.684829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:56.685812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:09:56.686864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:56.690079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 521/1066] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:09:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:56.692041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:56.778045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:56.793877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb685b-914a-4bd0-9f97-eb0babe55e08 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:56.829328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:56.830027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.830306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.830584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.831416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:56.831729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:56.833158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91fad-e98a-4479-afb3-65e257c71078 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:56.851233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 546/1067] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:09:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:56.857290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:56.922292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:56.964211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c045b-7de1-4b05-a3af-f8d98498abbe None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.964500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c045b-7de1-4b05-a3af-f8d98498abbe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.964781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c045b-7de1-4b05-a3af-f8d98498abbe None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.966299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 547/1068] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:56.971012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:56.971308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:56.971582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:56.982749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b397-af10-4edc-8655-a596ef7aba34 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:56.990109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:56.991344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:57.027641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.028633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.028960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.029198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.042140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.043608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:57.063841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:57.065037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:57.066245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:57.066245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:57.066245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:57.066245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:57.066245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 522/1069] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:57.071273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.072080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 548/1070] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:09:57.094606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.175269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.198083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890559c-b31a-4fd1-a309-f0213eb11537 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.200382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfc375-2125-4140-8b30-9d4001a1d264 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.206624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.236246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.237050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.237341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.237623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.239620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.240575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.240867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.241145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.242581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:57.243043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.244680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.248618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:09:57.256220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:57.257201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:09:57.265303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:57.266147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 523/1072] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:57.266242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 549/1072] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:57.271739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.274157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.386416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301f453-b760-48e5-8d5f-12538411980c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.386771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d359e-bf66-4220-a842-2c2039389bb4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.421522 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.422348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.422633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.422906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.425263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.425983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.426261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.426541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.427295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:57.427603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.428971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.430492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.431070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.431932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.439292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 550/1073] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:57.445614 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:09:57.448890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:57.450294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:09:57.451200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 524/1074] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:09:57.454910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.482901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.560762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c2f1-fc0f-4714-ae8f-02f6963c2d92 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.562527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4bf4-a7f6-461a-b1b2-1c8ebed30838 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.596310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.596965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.597245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.597520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.598357 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:57.598669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.600098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.601632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a70033-70fa-49a3-b6d3-bcee5f3a2de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.602536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a70033-70fa-49a3-b6d3-bcee5f3a2de9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.602819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a70033-70fa-49a3-b6d3-bcee5f3a2de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.603097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a70033-70fa-49a3-b6d3-bcee5f3a2de9 None admin] PATH_INFO: `/v3/users/0a3f4c3f5c1848d39913a05dcf16f8c6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.604291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a70033-70fa-49a3-b6d3-bcee5f3a2de9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3f4c3f5c1848d39913a05dcf16f8c6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.605742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a70033-70fa-49a3-b6d3-bcee5f3a2de9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.607421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 551/1075] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/users/0a3f4c3f5c1848d39913a05dcf16f8c6 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:57.608592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f62d2-c0ef-48ff-b4e3-fe7407e486ca None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.608881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f62d2-c0ef-48ff-b4e3-fe7407e486ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.609159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f62d2-c0ef-48ff-b4e3-fe7407e486ca None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.610554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 552/1076] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:57.611778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 525/1077] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:57.613034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f62d2-c0ef-48ff-b4e3-fe7407e486ca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.617673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.675760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.700816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.714207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f62d2-c0ef-48ff-b4e3-fe7407e486ca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.715088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbaf75-5f0a-4123-a207-6f37f1ed9ca1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.748702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.748876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4cc03-da03-4205-8268-c4b1574e997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:57.749583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.749689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4cc03-da03-4205-8268-c4b1574e997d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.749866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.749965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4cc03-da03-4205-8268-c4b1574e997d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.750182 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/99f73e12101d42c9b94d8b19ec555055/roles/3572b03c68264c7ab77c18ee1493a9d5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.750290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4cc03-da03-4205-8268-c4b1574e997d None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.751408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4cc03-da03-4205-8268-c4b1574e997d None admin] RBAC: Authorizing `identity:get_project(project_id=0129b5cdd8584d76b63c4f1478f871b1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.752411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=99f73e12101d42c9b94d8b19ec555055, role_id=3572b03c68264c7ab77c18ee1493a9d5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:57.752843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4cc03-da03-4205-8268-c4b1574e997d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.753837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:57.754567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 553/1078] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:09:57.755709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:57.756003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:57.756278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:57.772657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:57.773877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:57.841139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 554/1079] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:57.841944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.844136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 526/1080] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:57 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/99f73e12101d42c9b94d8b19ec555055/roles/3572b03c68264c7ab77c18ee1493a9d5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:09:57.863909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:57.916079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:57.958151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317ee6-d0d9-45eb-a986-27c8a1447dd1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:57.984628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3b89-779a-43a9-ba50-8decdf672a54 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:58.005404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:58.006653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:58.007173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:58.007628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1/users/0a3f4c3f5c1848d39913a05dcf16f8c6/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:58.009867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] RBAC: Authorizing `identity:create_grant(project_id=0129b5cdd8584d76b63c4f1478f871b1, user_id=0a3f4c3f5c1848d39913a05dcf16f8c6, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:58.011362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:58.025215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:58.030496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:58.030496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:58.030496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:58.042973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:58.093547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:58.095042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:58.150028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 555/1081] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:09:57 2022] PUT /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1/users/0a3f4c3f5c1848d39913a05dcf16f8c6/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:09:58.213673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 527/1082] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:09:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:09:58.219550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:58.335985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d090-011a-455a-86ef-43e79a00a332 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:58.358406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:58.369792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:58.370616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:58.370901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:58.371175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:58.381644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:58.383168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e9d44f80-0600-4235-9a90-086831f327dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:09:58.400596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:09:58.401563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:09:58.402507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:09:58.402507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:09:58.402507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:09:58.402507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:09:58.402507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 556/1083] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:09:58.409661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:09:58.456813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:58.509860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c8f86-fcde-4a0c-87e8-36299d43f7a5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:09:58.544184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:09:58.544845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:58.545124 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:58.545398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:58.546142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:09:58.546452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:09:58.547828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cfc89-952e-44b8-a015-85684c5aab7e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:09:58.566042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 528/1084] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:09:59.901694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4e85b-8aa8-401c-88c3-94d99e95fcfc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:59.902278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4e85b-8aa8-401c-88c3-94d99e95fcfc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:59.902278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4e85b-8aa8-401c-88c3-94d99e95fcfc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:59.903764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 557/1085] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:09:59.909041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:09:59.909470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:09:59.909600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:09:59.926673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:09:59.933713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:09:59.997028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 529/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:09:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:00.020248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4e85b-8aa8-401c-88c3-94d99e95fcfc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.123053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4e85b-8aa8-401c-88c3-94d99e95fcfc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.156006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3371f-4058-44d2-bc07-9300e52d8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.156745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3371f-4058-44d2-bc07-9300e52d8a37 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.157031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3371f-4058-44d2-bc07-9300e52d8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.157312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3371f-4058-44d2-bc07-9300e52d8a37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.168679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3371f-4058-44d2-bc07-9300e52d8a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5ee3371f-4058-44d2-bc07-9300e52d8a37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:00.176713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:00.177625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:00.178701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 558/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:00.183776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.195666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c3d4-ec19-49cc-9337-9c9218e2b883 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.195963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c3d4-ec19-49cc-9337-9c9218e2b883 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.196248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c3d4-ec19-49cc-9337-9c9218e2b883 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.197597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 559/1088] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:00.202501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.202798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.203078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.218979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.220044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:00.221234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:00.248802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.284535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaffa0-7d16-4503-bf67-1949b28542b6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.288955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 560/1089] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:10:00.312114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.317869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.318562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.318848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.319127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.320434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:00.320744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.322177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.330135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 530/1090] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:00.336162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.413054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cee775-8d31-4e9c-970a-7767e9bd2450 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.428837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.432470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5721fa-e8ea-4643-87d3-c23b1fd6a3c9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.447388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.448179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.448476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.448754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.458908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:00.465583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.466382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.466665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.466940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:00.467031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:00.468126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:00.469602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 561/1091] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:10:00.474090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.480237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.481693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.498894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:10:00.499880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:00.500829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:00.501736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:10:00.501736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:10:00.501736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:10:00.501736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:00.501736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 531/1092] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:10:00.506727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.573546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca37b96-f622-475f-9692-1a03a2b7803b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.604281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862de37c-8f97-4045-bb5f-b258f127f66a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.606575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.607251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.607538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.607818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.608575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:00.608884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.610288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.618903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 562/1093] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:00.624467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.640398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.641060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.641345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.641625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.642376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:00.642686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.644058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.655071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 532/1094] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:00.660489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.672631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.712069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.726483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbcd7-b4d5-4ac5-aaf1-e05c17a9551c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.759566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c43d6-4a25-4e37-99d7-4142e9048315 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.760663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.761540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.761832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.762147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] PATH_INFO: `/v3/users/0a3f4c3f5c1848d39913a05dcf16f8c6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.763385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3f4c3f5c1848d39913a05dcf16f8c6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.764826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.766493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 563/1095] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/users/0a3f4c3f5c1848d39913a05dcf16f8c6 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:00.771991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.793044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.793826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.794134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.794415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.801812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.803308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:10:00.817525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:00.818515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:00.820546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 533/1096] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:10:00.824801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:00.870608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570125e7-effa-4b44-83ab-9b7dfe930679 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.892650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.904771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.905424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.905713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.906016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.925546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c09d7-4c10-4180-b629-d1307acea385 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:00.930340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.957686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:00.958382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:00.958670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:00.958948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:00.959779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:00.960092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.961585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.974338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:00.975893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:00.979350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 534/1097] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:00.984860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.076488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 564/1098] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:10:01.082341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.083464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10345083-8290-4268-8400-13baf502bcb7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.112116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.120420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.121077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.133474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.133474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.140265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.184273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd581383-5381-450c-954a-e4a9130b613d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.188347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.189812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.218102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.218960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.219243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.219516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.220687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=0129b5cdd8584d76b63c4f1478f871b1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.222156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.223842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 565/1099] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:01.230268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.287898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 535/1100] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:10:01.294466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.321245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.333481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ea31-cee5-41cc-9982-674906d74dd9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.356668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.368512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.369162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.369445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.369720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.370627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=0129b5cdd8584d76b63c4f1478f871b1, user.id=0a3f4c3f5c1848d39913a05dcf16f8c6) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:01.370942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.372379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.378255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 566/1101] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/role_assignments?user.id=0a3f4c3f5c1848d39913a05dcf16f8c6&scope.project.id=0129b5cdd8584d76b63c4f1478f871b1&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:01.390944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181669f5-7d7d-47a2-9282-eff378fd19a0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.428642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.429491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.429776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.430088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.441416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.442860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:10:01.462037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:01.463232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:01.464476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:10:01.464476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:10:01.464476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:10:01.464476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:01.464476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 536/1102] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:10:01.469420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.582116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf37d-e974-4d86-89a0-b43f37f7800c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.615692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.616358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.617180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.617459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.618215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:01.618527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.619901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.631390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 567/1103] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:01.637499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.715577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.734774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fe10-7754-4754-81a9-b5779be2ef00 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.768721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.769512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.769794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.770097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.776656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.778132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:10:01.792221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:01.793258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:01.794509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 537/1104] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:01.799137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:01.845352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.909390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2843f-16c0-48eb-8985-f659f9147938 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:01.946702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:01.947358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:01.947638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:01.947912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:01.948850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:01.949163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:01.950635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966abe0-f2cc-4881-aab8-af0e747af8e6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:01.961825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 568/1105] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:01.967921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:02.066041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287116fc-c9fc-4d30-9ef0-ed3c42daf06b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:02.098554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:02.099201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:02.099486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:02.099764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:02.100588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] RBAC: Adding query filter params (role.id=3572b03c68264c7ab77c18ee1493a9d5, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=99f73e12101d42c9b94d8b19ec555055) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:02.100900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:02.103017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49474420-7d0a-46d8-8c22-d896533ba7c9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:02.109976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 538/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:01 2022] GET /identity/v3/role_assignments?user.id=99f73e12101d42c9b94d8b19ec555055&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=3572b03c68264c7ab77c18ee1493a9d5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:03.459110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b13c6f-7373-48f1-9226-c5e65063f381 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:03.459645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b13c6f-7373-48f1-9226-c5e65063f381 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:03.459645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b13c6f-7373-48f1-9226-c5e65063f381 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:03.461620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 569/1107] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:03.466710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:03.467074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:03.467278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:03.473241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:03.484417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:03.485608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:03.550876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 539/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:03.579152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b13c6f-7373-48f1-9226-c5e65063f381 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:03.679608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b13c6f-7373-48f1-9226-c5e65063f381 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:03.686203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:03.712371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828b96f-2469-4e04-b7ff-f82c244bb12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:03.713097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b96f-2469-4e04-b7ff-f82c244bb12e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:03.713378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b96f-2469-4e04-b7ff-f82c244bb12e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:03.713655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b96f-2469-4e04-b7ff-f82c244bb12e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:03.714835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828b96f-2469-4e04-b7ff-f82c244bb12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:03.716306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828b96f-2469-4e04-b7ff-f82c244bb12e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:03.718280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 570/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:10:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:03.723631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:03.818553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e744541-4d69-4acc-93dd-edd0ca76b804 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:03.851317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c6ff5-6184-4064-bd83-9e7038b9dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:03.851971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6ff5-6184-4064-bd83-9e7038b9dcb7 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:03.852255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6ff5-6184-4064-bd83-9e7038b9dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:03.852531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6ff5-6184-4064-bd83-9e7038b9dcb7 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:03.853227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c6ff5-6184-4064-bd83-9e7038b9dcb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:03.854698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c6ff5-6184-4064-bd83-9e7038b9dcb7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:03.861169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:03.958013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 540/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:10:03 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:10:06.010648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036249-3475-4c53-ba8a-9dc56a752b53 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.011174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036249-3475-4c53-ba8a-9dc56a752b53 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.011278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36036249-3475-4c53-ba8a-9dc56a752b53 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.012586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 571/1111] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:06.017778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.018234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.018359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.034739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:06.035912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:06.100352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 541/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:06.124401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36036249-3475-4c53-ba8a-9dc56a752b53 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:06.223634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36036249-3475-4c53-ba8a-9dc56a752b53 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:06.257307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:06.258174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.258461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.258735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] PATH_INFO: `/v3/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.260198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] RBAC: Authorizing `identity:get_role(role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:06.261608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:06.262922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 572/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:06 2022] GET /identity/v3/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:06.268614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:06.363815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4bca8-94ce-4b0f-a096-46d0a620b91c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:06.383251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:06.396497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:06.397343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.397626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.397926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] PATH_INFO: `/v3/users/af67b9c64d3748f5bb1f41333de3c573` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.410350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=af67b9c64d3748f5bb1f41333de3c573)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:06.411804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:06.414325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 542/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:06 2022] GET /identity/v3/users/af67b9c64d3748f5bb1f41333de3c573 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:06.419894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:06.462228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:06.516410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff6cc-a8fb-4d23-898e-f794566acb73 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:06.549522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:06.550184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.550474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.550753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.615445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:06.617398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:06.656792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:06.712148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 573/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:06.718028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:06.814247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c753-4b84-43d6-b97a-ae4c6898a1f7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:06.846931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f105b-5f50-4f03-b1c0-c9974993d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:06.847780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f105b-5f50-4f03-b1c0-c9974993d3ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.848068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f105b-5f50-4f03-b1c0-c9974993d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.848348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f105b-5f50-4f03-b1c0-c9974993d3ea None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.849521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f105b-5f50-4f03-b1c0-c9974993d3ea None admin] RBAC: Authorizing `identity:get_project(project_id=0129b5cdd8584d76b63c4f1478f871b1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:06.851011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f105b-5f50-4f03-b1c0-c9974993d3ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:06.852697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 543/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:06 2022] GET /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:06.858586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:06.958166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce223-9a0b-4278-b9a4-9343c5759487 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:06.992272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:06.993354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:06.993641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:06.993916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:06.994767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] RBAC: Adding query filter params (role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=0129b5cdd8584d76b63c4f1478f871b1, user.id=af67b9c64d3748f5bb1f41333de3c573) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:06.995079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:06.996612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272db0ed-4a15-4b2f-97f2-3e2eb4418418 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:07.001908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 574/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:06 2022] GET /identity/v3/role_assignments?user.id=af67b9c64d3748f5bb1f41333de3c573&scope.project.id=0129b5cdd8584d76b63c4f1478f871b1&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:08.973744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f184-8bd4-490f-8673-eb663f778020 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:08.974303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f184-8bd4-490f-8673-eb663f778020 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:08.974303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f184-8bd4-490f-8673-eb663f778020 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:08.975754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 544/1118] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:08.981452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:08.981832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:08.982025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:08.993203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:08.999292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:09.000550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:09.069674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 575/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:09.092735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f184-8bd4-490f-8673-eb663f778020 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:09.142685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:09.197719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f184-8bd4-490f-8673-eb663f778020 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:09.232125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:09.232906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:09.233190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:09.233496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] PATH_INFO: `/v3/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:09.235007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] RBAC: Authorizing `identity:get_role(role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:09.236383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:09.237739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 545/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:09 2022] GET /identity/v3/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:09.243989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:09.346479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb662b-b55a-4c31-af4a-420b5d9a1e94 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:09.378878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:09.379743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:09.380035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:09.380316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] PATH_INFO: `/v3/users/af67b9c64d3748f5bb1f41333de3c573` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:09.381501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] RBAC: Authorizing `identity:get_user(user_id=af67b9c64d3748f5bb1f41333de3c573)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:09.382973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:09.385114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 576/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:09 2022] GET /identity/v3/users/af67b9c64d3748f5bb1f41333de3c573 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:09.391042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:09.486854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9b0be-3dd5-4f4b-8ded-48ee4035b65e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:09.500097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:09.519343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e24c-275a-4eb9-b44c-0c3eca3b0da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:09.520175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e24c-275a-4eb9-b44c-0c3eca3b0da9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:09.520460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e24c-275a-4eb9-b44c-0c3eca3b0da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:09.520736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e24c-275a-4eb9-b44c-0c3eca3b0da9 None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:09.521895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983e24c-275a-4eb9-b44c-0c3eca3b0da9 None admin] RBAC: Authorizing `identity:get_project(project_id=0129b5cdd8584d76b63c4f1478f871b1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:09.523355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983e24c-275a-4eb9-b44c-0c3eca3b0da9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:09.525641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 546/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:09 2022] GET /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:09.531418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:09.535154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:09.628241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19aaed-121f-45ad-9811-ee661f885f8e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:09.663618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb806f5-e43f-4b90-a331-54bb8e886353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:09.665428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb806f5-e43f-4b90-a331-54bb8e886353 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:09.665912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb806f5-e43f-4b90-a331-54bb8e886353 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:09.666430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb806f5-e43f-4b90-a331-54bb8e886353 None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1/users/af67b9c64d3748f5bb1f41333de3c573/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:09.669282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb806f5-e43f-4b90-a331-54bb8e886353 None admin] RBAC: Authorizing `identity:create_grant(project_id=0129b5cdd8584d76b63c4f1478f871b1, user_id=af67b9c64d3748f5bb1f41333de3c573, role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:09.670843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb806f5-e43f-4b90-a331-54bb8e886353 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:09.780378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 577/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:10:09 2022] PUT /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1/users/af67b9c64d3748f5bb1f41333de3c573/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:10:11.760777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b81f2-3871-45bc-8779-6c76b11b424a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:11.761330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b81f2-3871-45bc-8779-6c76b11b424a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:11.761330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b81f2-3871-45bc-8779-6c76b11b424a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:11.762717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 547/1124] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:11.767899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081015-684d-4139-bff4-ae2028442021 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:11.768263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081015-684d-4139-bff4-ae2028442021 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:11.768464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081015-684d-4139-bff4-ae2028442021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:11.785484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8d081015-684d-4139-bff4-ae2028442021 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:11.786696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8d081015-684d-4139-bff4-ae2028442021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:11.843834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:11.852525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 578/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:10:11.875716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b81f2-3871-45bc-8779-6c76b11b424a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:11.982459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b81f2-3871-45bc-8779-6c76b11b424a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:12.027408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:12.028179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:12.028465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:12.028743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] PATH_INFO: `/v3/roles/beb3dc53e2ba4e8389d7fd1077780bb8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:12.030263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] RBAC: Authorizing `identity:get_role(role_id=beb3dc53e2ba4e8389d7fd1077780bb8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:12.031647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:12.033051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 548/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:11 2022] GET /identity/v3/roles/beb3dc53e2ba4e8389d7fd1077780bb8 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:12.038835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d081015-684d-4139-bff4-ae2028442021 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:12.134688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d081015-684d-4139-bff4-ae2028442021 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:12.168150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:12.169018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:12.169308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:12.169590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] PATH_INFO: `/v3/users/af67b9c64d3748f5bb1f41333de3c573` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:12.170800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] RBAC: Authorizing `identity:get_user(user_id=af67b9c64d3748f5bb1f41333de3c573)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:12.172239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:12.173893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 579/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:12 2022] GET /identity/v3/users/af67b9c64d3748f5bb1f41333de3c573 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:12.179624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:12.228392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:12.276740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f82bd8-0d33-4036-91fb-666d82409eaa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:12.309212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:12.309786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:12.310100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:12.310387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:12.387809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:12.389276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:12.435840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:12.484839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 549/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:12.490842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:12.550739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:12.588548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc4679-b02a-41e7-9fc0-ac247fce7554 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:12.620949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe9773-0894-43c5-9f8d-28de5fcf52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:12.621806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe9773-0894-43c5-9f8d-28de5fcf52d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:12.622121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe9773-0894-43c5-9f8d-28de5fcf52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:12.622400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe9773-0894-43c5-9f8d-28de5fcf52d3 None admin] PATH_INFO: `/v3/projects/0129b5cdd8584d76b63c4f1478f871b1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:12.623565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe9773-0894-43c5-9f8d-28de5fcf52d3 None admin] RBAC: Authorizing `identity:get_project(project_id=0129b5cdd8584d76b63c4f1478f871b1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:12.624991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe9773-0894-43c5-9f8d-28de5fcf52d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:12.626690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 580/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:12 2022] GET /identity/v3/projects/0129b5cdd8584d76b63c4f1478f871b1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:12.632627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:12.734144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cd3e0-7b15-45fc-bcba-da393bca558b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:12.768134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:12.768780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:12.769064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:12.769341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:12.770196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] RBAC: Adding query filter params (role.id=beb3dc53e2ba4e8389d7fd1077780bb8, scope.project.id=0129b5cdd8584d76b63c4f1478f871b1, user.id=af67b9c64d3748f5bb1f41333de3c573) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:12.770512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:12.771949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034a817-5661-4917-b0f6-42a52a3a1fcb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:12.777756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 550/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:12 2022] GET /identity/v3/role_assignments?user.id=af67b9c64d3748f5bb1f41333de3c573&scope.project.id=0129b5cdd8584d76b63c4f1478f871b1&role.id=beb3dc53e2ba4e8389d7fd1077780bb8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:14.803491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7b10-2f73-4e39-bd38-13d78844813c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:14.804037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7b10-2f73-4e39-bd38-13d78844813c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:14.804037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7b10-2f73-4e39-bd38-13d78844813c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:14.805941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 581/1131] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:14.811066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:14.811441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:14.811622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:14.829163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:14.830381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:14.839439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:14.894522 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 551/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:14.917949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7b10-2f73-4e39-bd38-13d78844813c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:15.020860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7b10-2f73-4e39-bd38-13d78844813c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:15.048867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:15.054549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5d167-020e-477d-ad1f-e6a47eae2cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:15.055848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5d167-020e-477d-ad1f-e6a47eae2cbb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:15.056132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5d167-020e-477d-ad1f-e6a47eae2cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:15.056410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5d167-020e-477d-ad1f-e6a47eae2cbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:15.057585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5d167-020e-477d-ad1f-e6a47eae2cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:15.059097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5d167-020e-477d-ad1f-e6a47eae2cbb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:15.060705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 582/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:10:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:15.066555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:15.163693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa166-f0b1-4256-a5ad-d44f02c6923f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:15.197385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a7bb2-41e9-460b-b3da-7554f878c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:15.198063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7bb2-41e9-460b-b3da-7554f878c844 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:15.198355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7bb2-41e9-460b-b3da-7554f878c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:15.198634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7bb2-41e9-460b-b3da-7554f878c844 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:15.199347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a7bb2-41e9-460b-b3da-7554f878c844 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:15.200789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a7bb2-41e9-460b-b3da-7554f878c844 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:15.214267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:15.312906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 552/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:10:15 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:10:17.364675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d607b7-e8cb-4864-ad65-5613a27d3fe2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:17.365255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d607b7-e8cb-4864-ad65-5613a27d3fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:17.365255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d607b7-e8cb-4864-ad65-5613a27d3fe2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:17.366642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 583/1135] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:17.371727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:17.372146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:17.372290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:17.388687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:17.389865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:17.454740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 553/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:17.480030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d607b7-e8cb-4864-ad65-5613a27d3fe2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:17.588082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d607b7-e8cb-4864-ad65-5613a27d3fe2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:17.621601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c413cf7-8f10-4784-9628-85f8dd9f930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:17.622336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413cf7-8f10-4784-9628-85f8dd9f930f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:17.622624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413cf7-8f10-4784-9628-85f8dd9f930f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:17.622903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413cf7-8f10-4784-9628-85f8dd9f930f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:17.624072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c413cf7-8f10-4784-9628-85f8dd9f930f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:17.625513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c413cf7-8f10-4784-9628-85f8dd9f930f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:17.627161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 584/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:17.632920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:17.728043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80ae0-f791-4e7d-b738-c37dc5535493 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:17.751919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:17.760449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2b99f-394f-4af4-b96f-d3a6dd7ffafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:17.761098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2b99f-394f-4af4-b96f-d3a6dd7ffafc None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:17.766787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2b99f-394f-4af4-b96f-d3a6dd7ffafc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:17.766787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2b99f-394f-4af4-b96f-d3a6dd7ffafc None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:17.766787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2b99f-394f-4af4-b96f-d3a6dd7ffafc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:17.766787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2b99f-394f-4af4-b96f-d3a6dd7ffafc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:17.872305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 554/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:10:17 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:10:19.950467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5ede-509c-47f0-9be8-ea9c02127e5c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:19.950995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5ede-509c-47f0-9be8-ea9c02127e5c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:19.951158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5ede-509c-47f0-9be8-ea9c02127e5c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:19.953609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 585/1139] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:19.959038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:19.959501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:19.959614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:19.976525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:19.977722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:20.043905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 555/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:20.067711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5ede-509c-47f0-9be8-ea9c02127e5c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:20.133667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:20.168435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5ede-509c-47f0-9be8-ea9c02127e5c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:20.200904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:20.201622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:20.201904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:20.202208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:20.211940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:20.219839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:20.220932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:20.221829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 586/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:20.227026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:20.324862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f31c23-3200-4ad9-bd99-ab8d0b7312c7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:20.338050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:20.359119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:20.359805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:20.360156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:20.360437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:20.361180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:20.361491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:20.362896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:20.370846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 556/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:20.376544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:20.473680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a55a3-ab64-4148-8434-24ec2886a2b6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:20.497175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:20.505239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:20.513739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:20.513739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:20.513739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] PATH_INFO: `/v3/users/516a80e6bc5c4871bd86ab7857847d4f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:20.519587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] RBAC: Authorizing `identity:get_user(user_id=516a80e6bc5c4871bd86ab7857847d4f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:20.521053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:20.522693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 587/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:20 2022] GET /identity/v3/users/516a80e6bc5c4871bd86ab7857847d4f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:20.528931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:20.626722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ec75e-372a-49e1-8009-4c0eed57aede None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:20.659769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:20.660396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:20.660682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:20.660962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:20.701841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:20.726407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:20.727890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:20.823709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 557/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:10:20.829488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:20.924757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733cccf-e25b-4487-8020-6cc27c6335b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:20.957627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d9816-3a94-4bfa-97e5-9e6cf0abc942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:20.958505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9816-3a94-4bfa-97e5-9e6cf0abc942 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:20.958787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9816-3a94-4bfa-97e5-9e6cf0abc942 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:20.959061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9816-3a94-4bfa-97e5-9e6cf0abc942 None admin] PATH_INFO: `/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:20.960223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d9816-3a94-4bfa-97e5-9e6cf0abc942 None admin] RBAC: Authorizing `identity:get_project(project_id=6c98e6f5120e463ba72cd6bf60f251fa)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:20.961633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d9816-3a94-4bfa-97e5-9e6cf0abc942 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:20.963331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 588/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:20 2022] GET /identity/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:20.969364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:21.043501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:21.067931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d4bb-1eee-4be1-b5a6-738b3abe77ed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:21.100890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:21.101533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:21.101817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:21.102138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:21.102990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=6c98e6f5120e463ba72cd6bf60f251fa, user.id=516a80e6bc5c4871bd86ab7857847d4f) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:21.103306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:21.104745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78f7e-422f-4e14-aa84-24fc816ec85f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:21.110247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 558/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:20 2022] GET /identity/v3/role_assignments?user.id=516a80e6bc5c4871bd86ab7857847d4f&scope.project.id=6c98e6f5120e463ba72cd6bf60f251fa&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:10:23.101141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787cc5f-1c3c-415d-b123-0ea3bb3212f0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.101666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787cc5f-1c3c-415d-b123-0ea3bb3212f0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.101757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787cc5f-1c3c-415d-b123-0ea3bb3212f0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.103681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 589/1147] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:23.108900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.109300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.109446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.125717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:23.126924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:23.190932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 559/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:23.213731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787cc5f-1c3c-415d-b123-0ea3bb3212f0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:23.266128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:23.312957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787cc5f-1c3c-415d-b123-0ea3bb3212f0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:23.346066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:23.346846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.347136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.347418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.358022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:23.365476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:23.366578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:23.367711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 590/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:23.372760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:23.438962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:23.471046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06530a99-fe67-418e-a3f9-ccfb344a7730 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:23.503051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:23.503696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.503974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.504244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.504981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:23.505282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:23.506672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:23.514924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 560/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:23.520661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:23.617197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ca20c-511f-4ee8-9b24-3682352ff746 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:23.629513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:23.650554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:23.651405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.651686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.651962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] PATH_INFO: `/v3/users/516a80e6bc5c4871bd86ab7857847d4f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.653133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] RBAC: Authorizing `identity:get_user(user_id=516a80e6bc5c4871bd86ab7857847d4f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:23.654593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:23.656254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 591/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:23 2022] GET /identity/v3/users/516a80e6bc5c4871bd86ab7857847d4f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:23.661795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:23.757728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575afebb-e443-4c09-972c-875b6e54b015 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:23.785000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:23.790772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c2383-8cac-4ef0-867d-0c60714f35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:23.791608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2383-8cac-4ef0-867d-0c60714f35da None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.791887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2383-8cac-4ef0-867d-0c60714f35da None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.792158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2383-8cac-4ef0-867d-0c60714f35da None admin] PATH_INFO: `/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.797747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2383-8cac-4ef0-867d-0c60714f35da None admin] RBAC: Authorizing `identity:get_project(project_id=6c98e6f5120e463ba72cd6bf60f251fa)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:23.797747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2383-8cac-4ef0-867d-0c60714f35da None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:23.797747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 561/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:23 2022] GET /identity/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:23.802151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:23.899796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd839d0-6e53-47aa-b82e-e066c69b19dd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:23.932234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8d3cd-ad27-4475-a9d1-5181e9ca2fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:23.933121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d3cd-ad27-4475-a9d1-5181e9ca2fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:23.933406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d3cd-ad27-4475-a9d1-5181e9ca2fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:23.933684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d3cd-ad27-4475-a9d1-5181e9ca2fd0 None admin] PATH_INFO: `/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa/users/516a80e6bc5c4871bd86ab7857847d4f/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:23.935695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8d3cd-ad27-4475-a9d1-5181e9ca2fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c98e6f5120e463ba72cd6bf60f251fa, user_id=516a80e6bc5c4871bd86ab7857847d4f, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:23.937131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8d3cd-ad27-4475-a9d1-5181e9ca2fd0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:24.019926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 592/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:10:23 2022] PUT /identity/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa/users/516a80e6bc5c4871bd86ab7857847d4f/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:10:26.007591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce10-2f47-4227-a484-c8bef9b7fa41 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:26.008152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce10-2f47-4227-a484-c8bef9b7fa41 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:26.008152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce10-2f47-4227-a484-c8bef9b7fa41 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:26.010054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 562/1154] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:26.015336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:26.015729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:26.015895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:26.032974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:26.034219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:26.067856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:26.099777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 593/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:26.123382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce10-2f47-4227-a484-c8bef9b7fa41 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:26.222876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce10-2f47-4227-a484-c8bef9b7fa41 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:26.255493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:26.256266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:26.256566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:26.256829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:26.267287 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:26.274813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:26.275880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:26.276741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 563/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:26.281887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:26.376994 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a286152-f39d-41f0-9c86-193bd21d7a52 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:26.409592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:26.410277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:26.410567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:26.410850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:26.411593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:26.411903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:26.413277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:26.421812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 594/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:26.427212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:26.483687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:26.523310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b014-a931-48a4-a82a-abc808336a76 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:26.556803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:26.557791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:26.558095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:26.558369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] PATH_INFO: `/v3/users/516a80e6bc5c4871bd86ab7857847d4f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:26.559552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] RBAC: Authorizing `identity:get_user(user_id=516a80e6bc5c4871bd86ab7857847d4f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:26.560980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:26.562621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 564/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:26 2022] GET /identity/v3/users/516a80e6bc5c4871bd86ab7857847d4f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:26.568287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:26.598796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:26.664882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dec69-2b01-435a-b226-0eb6df0758dc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:26.697350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:26.697986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:26.698297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:26.698575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:26.762553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:26.763993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:26.793193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:26.858742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 595/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:26.864426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:26.961224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50e19-e03a-48bd-a280-ee5a192c7d6a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:26.986421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:26.995086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320602a5-c1d6-423e-98ee-c5b2a4bc35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:27.001849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320602a5-c1d6-423e-98ee-c5b2a4bc35cf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:27.001849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320602a5-c1d6-423e-98ee-c5b2a4bc35cf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:27.001849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320602a5-c1d6-423e-98ee-c5b2a4bc35cf None admin] PATH_INFO: `/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:27.001849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320602a5-c1d6-423e-98ee-c5b2a4bc35cf None admin] RBAC: Authorizing `identity:get_project(project_id=6c98e6f5120e463ba72cd6bf60f251fa)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:27.001849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320602a5-c1d6-423e-98ee-c5b2a4bc35cf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:27.001849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 565/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:26 2022] GET /identity/v3/projects/6c98e6f5120e463ba72cd6bf60f251fa => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:27.006729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:27.102288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a544e4-8a25-44b6-8019-731322561fef None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:27.130917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:27.135742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:27.136390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:27.136676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:27.136955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:27.137779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=6c98e6f5120e463ba72cd6bf60f251fa, user.id=516a80e6bc5c4871bd86ab7857847d4f) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:27.138126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:27.139556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4822-9b5d-4db7-a68d-073d3328db52 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:27.145171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 596/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:27 2022] GET /identity/v3/role_assignments?user.id=516a80e6bc5c4871bd86ab7857847d4f&scope.project.id=6c98e6f5120e463ba72cd6bf60f251fa&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:29.167845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22583dd-b751-4d40-a94f-d5e01b9ea5ae None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:29.168384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22583dd-b751-4d40-a94f-d5e01b9ea5ae None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:29.168384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22583dd-b751-4d40-a94f-d5e01b9ea5ae None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:29.169768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 566/1162] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:29.174940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:29.175331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:29.175492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:29.192889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:29.194081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:29.257336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 597/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:29.279604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22583dd-b751-4d40-a94f-d5e01b9ea5ae None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:29.378303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22583dd-b751-4d40-a94f-d5e01b9ea5ae None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:29.412416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:29.414131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:29.414688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:29.414964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:29.475301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:29.482935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:29.484398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:29.579681 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 567/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:29.585786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:29.680487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85a0e-e940-4551-b189-060030ebcb11 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:29.706765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:29.715551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:29.718465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:29.718465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:29.718465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:29.723642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:29.725088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2f0c22a8-6752-45a7-9678-1c02bc323b9a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:29.740289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:29.741590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:29.742595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 598/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:10:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:29.748286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:29.837508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:29.843978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c1b54-06e9-45ee-ad77-8b3cf71fab20 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:29.877080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:29.877727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:29.878032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:29.878317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:29.879036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:29.879347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:29.880722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e0a7-db73-474d-b5cf-e00daf841da7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:29.887619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 568/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jun 20 12:10:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:31.869768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610266-2388-4d5e-92c0-11971dfdb153 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:31.870374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610266-2388-4d5e-92c0-11971dfdb153 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:31.870374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610266-2388-4d5e-92c0-11971dfdb153 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:31.871696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 599/1167] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:31.876868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1c14-21e4-4c45-9209-3c8616b2f5b1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:31.877246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1c14-21e4-4c45-9209-3c8616b2f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:31.877433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1c14-21e4-4c45-9209-3c8616b2f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:31.893772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c02a1c14-21e4-4c45-9209-3c8616b2f5b1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:31.894995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c02a1c14-21e4-4c45-9209-3c8616b2f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:31.958909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 569/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:31.981857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610266-2388-4d5e-92c0-11971dfdb153 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:32.089393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610266-2388-4d5e-92c0-11971dfdb153 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:32.131845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea096b3-8098-4d4e-a596-b3382e6a8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:32.131845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea096b3-8098-4d4e-a596-b3382e6a8d07 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:32.131845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea096b3-8098-4d4e-a596-b3382e6a8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:32.131845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea096b3-8098-4d4e-a596-b3382e6a8d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:32.132257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea096b3-8098-4d4e-a596-b3382e6a8d07 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:32.132257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea096b3-8098-4d4e-a596-b3382e6a8d07 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:32.306835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 600/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Mon Jun 20 12:10:31 2022] POST /identity/v3/domains => generated 267 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:10:34.413936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9f42b-23a9-470a-a036-d3e6437201c3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:34.414747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9f42b-23a9-470a-a036-d3e6437201c3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:34.414845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9f42b-23a9-470a-a036-d3e6437201c3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:34.416171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 570/1170] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:34.421273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:34.421682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:34.421828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:34.438860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:34.440038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:34.480449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:34.504084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 601/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:34.527463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9f42b-23a9-470a-a036-d3e6437201c3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:34.612583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:34.625417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9f42b-23a9-470a-a036-d3e6437201c3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:34.658283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e3a0-a753-4abc-a9b8-fd390373180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:34.659124 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e3a0-a753-4abc-a9b8-fd390373180a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:34.659407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e3a0-a753-4abc-a9b8-fd390373180a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:34.659683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e3a0-a753-4abc-a9b8-fd390373180a None admin] PATH_INFO: `/v3/domains/342bc3b40300432db4f26fe84e394c57` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:34.670590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125e3a0-a753-4abc-a9b8-fd390373180a None admin] RBAC: Authorizing `identity:get_domain(domain_id=342bc3b40300432db4f26fe84e394c57)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:34.671987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125e3a0-a753-4abc-a9b8-fd390373180a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:34.673608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 571/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Jun 20 12:10:34 2022] GET /identity/v3/domains/342bc3b40300432db4f26fe84e394c57 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:34.679273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:34.774434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33254b-ad85-4448-8b75-d0a0aefaf787 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:34.807937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd7b3a-a39d-4277-bd30-70ef4fa8d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:34.808586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd7b3a-a39d-4277-bd30-70ef4fa8d7a2 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:34.808871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd7b3a-a39d-4277-bd30-70ef4fa8d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:34.809147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd7b3a-a39d-4277-bd30-70ef4fa8d7a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:34.809857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd7b3a-a39d-4277-bd30-70ef4fa8d7a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:34.811425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd7b3a-a39d-4277-bd30-70ef4fa8d7a2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:34.888966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 602/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:10:34 2022] POST /identity/v3/projects => generated 361 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:10:36.923541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65447e-d77f-4d15-b160-db02afc3d653 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:36.924094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65447e-d77f-4d15-b160-db02afc3d653 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:36.924094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65447e-d77f-4d15-b160-db02afc3d653 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:36.925464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 572/1174] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:36.931444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:36.932102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:36.932102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:36.948756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:36.949944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:36.971939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:37.015624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 603/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:37.041376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65447e-d77f-4d15-b160-db02afc3d653 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:37.141532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65447e-d77f-4d15-b160-db02afc3d653 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:37.175120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f5c3f-aa83-43f8-93d6-79f914ff388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:37.175902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5c3f-aa83-43f8-93d6-79f914ff388c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:37.176185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5c3f-aa83-43f8-93d6-79f914ff388c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:37.176458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5c3f-aa83-43f8-93d6-79f914ff388c None admin] PATH_INFO: `/v3/domains/342bc3b40300432db4f26fe84e394c57` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:37.177616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f5c3f-aa83-43f8-93d6-79f914ff388c None admin] RBAC: Authorizing `identity:get_domain(domain_id=342bc3b40300432db4f26fe84e394c57)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:37.179079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f5c3f-aa83-43f8-93d6-79f914ff388c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:37.180682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 573/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Jun 20 12:10:37 2022] GET /identity/v3/domains/342bc3b40300432db4f26fe84e394c57 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:37.186999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:37.282448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474cfb3-ca8f-4c5f-9aa0-ff9f7a779455 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:37.315666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94131-f910-43db-890f-073713d623e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:37.316325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94131-f910-43db-890f-073713d623e7 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:37.316608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94131-f910-43db-890f-073713d623e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:37.316887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94131-f910-43db-890f-073713d623e7 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:37.317594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94131-f910-43db-890f-073713d623e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:37.319169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94131-f910-43db-890f-073713d623e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:37.423384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 604/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:10:37 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:10:39.486060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d0ea3-eade-4142-ba0f-c1110eae65a5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:39.486595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d0ea3-eade-4142-ba0f-c1110eae65a5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:39.486694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d0ea3-eade-4142-ba0f-c1110eae65a5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:39.488002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 574/1178] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:39.493109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d0012-f69b-4871-a5b4-436203848920 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:39.493575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d0012-f69b-4871-a5b4-436203848920 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:39.493677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d0012-f69b-4871-a5b4-436203848920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:39.510403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-381d0012-f69b-4871-a5b4-436203848920 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:39.511571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-381d0012-f69b-4871-a5b4-436203848920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:39.520575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:39.576145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 605/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:39.599496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d0ea3-eade-4142-ba0f-c1110eae65a5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:39.617179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:39.699504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d0ea3-eade-4142-ba0f-c1110eae65a5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:39.732557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:39.733332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:39.733615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:39.733888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:39.744277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:39.751763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:39.752854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:39.754245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 575/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:39.758912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d0012-f69b-4871-a5b4-436203848920 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:39.853885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d0012-f69b-4871-a5b4-436203848920 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:39.887262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:39.887913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:39.888195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:39.888469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:39.889205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:39.889507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:39.890886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:39.898757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 606/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:39.904342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:39.980167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:40.002425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82655e9-e7b6-425e-8964-132d78e34a60 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:40.034559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:40.035414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:40.035697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:40.035973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] PATH_INFO: `/v3/users/f020a2726faf4148aded5bc595d14897` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:40.049499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] RBAC: Authorizing `identity:get_user(user_id=f020a2726faf4148aded5bc595d14897)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:40.050990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:40.052632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 576/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:39 2022] GET /identity/v3/users/f020a2726faf4148aded5bc595d14897 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:40.059007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:40.069518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:40.171300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505030a-35fa-420b-8fac-e498a723bf57 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:40.204310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:40.204952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:40.205238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:40.205517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:40.271362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:40.272750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:40.280552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:40.367478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 607/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:40.373335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:40.473839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24e355-f223-4e5a-8941-7b4bc64d2761 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:40.506689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9e548-c616-4b1c-9507-1876863c7f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:40.507535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9e548-c616-4b1c-9507-1876863c7f43 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:40.507812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9e548-c616-4b1c-9507-1876863c7f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:40.508082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9e548-c616-4b1c-9507-1876863c7f43 None admin] PATH_INFO: `/v3/projects/04eb6b658af04bc5b5cb56c007286112` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:40.509271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9e548-c616-4b1c-9507-1876863c7f43 None admin] RBAC: Authorizing `identity:get_project(project_id=04eb6b658af04bc5b5cb56c007286112)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:40.510735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9e548-c616-4b1c-9507-1876863c7f43 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:40.512408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 577/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:40 2022] GET /identity/v3/projects/04eb6b658af04bc5b5cb56c007286112 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:40.518514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:40.616083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478d12-022b-4723-be2e-42429135ebc4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:40.623085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:40.649140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:40.650402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:40.650687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:40.650964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:40.651784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=04eb6b658af04bc5b5cb56c007286112, user.id=f020a2726faf4148aded5bc595d14897) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:40.652100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:40.653532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f021a-a4a6-4d80-bce3-706a64e9e668 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:40.658900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 608/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:40 2022] GET /identity/v3/role_assignments?user.id=f020a2726faf4148aded5bc595d14897&scope.project.id=04eb6b658af04bc5b5cb56c007286112&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:42.654350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195de032-7290-4891-ba45-ad82767adbba None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:42.654904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195de032-7290-4891-ba45-ad82767adbba None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:42.654904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195de032-7290-4891-ba45-ad82767adbba None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:42.656274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 578/1186] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:42.661495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:42.661856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:42.662088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:42.679288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:42.680473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:42.750129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 609/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:42.773358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195de032-7290-4891-ba45-ad82767adbba None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:42.776290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:42.873186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195de032-7290-4891-ba45-ad82767adbba None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:42.906033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:42.906738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:42.907027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:42.907301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:42.917841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:42.925476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:42.926602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:10:42.927698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 579/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:42.933324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:43.026246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:43.029103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706807-dc64-479a-b21e-7500e98f7236 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:43.062919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:43.063584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:43.063874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:43.064157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:43.064907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:43.065220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:43.066632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:43.074648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 610/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:43.080544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:43.146745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:43.185810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017c63-1266-45d0-a895-c0380d54831d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:43.218176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:43.219042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:43.219324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:43.219598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] PATH_INFO: `/v3/users/f020a2726faf4148aded5bc595d14897` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:43.220778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] RBAC: Authorizing `identity:get_user(user_id=f020a2726faf4148aded5bc595d14897)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:43.222250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:43.223895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 580/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:43 2022] GET /identity/v3/users/f020a2726faf4148aded5bc595d14897 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:43.230277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:43.326841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc4641-2232-4028-a4a0-cddc25adb731 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:43.360620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f798b4a-3024-4bf6-90bf-954aaa6ed61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:43.361482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f798b4a-3024-4bf6-90bf-954aaa6ed61f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:43.361773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f798b4a-3024-4bf6-90bf-954aaa6ed61f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:43.362090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f798b4a-3024-4bf6-90bf-954aaa6ed61f None admin] PATH_INFO: `/v3/projects/04eb6b658af04bc5b5cb56c007286112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:43.363271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f798b4a-3024-4bf6-90bf-954aaa6ed61f None admin] RBAC: Authorizing `identity:get_project(project_id=04eb6b658af04bc5b5cb56c007286112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:43.364716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f798b4a-3024-4bf6-90bf-954aaa6ed61f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:43.366462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 611/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:43 2022] GET /identity/v3/projects/04eb6b658af04bc5b5cb56c007286112 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:43.372314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:43.468967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ad3c-ff51-40b8-b3d2-2b6a796a7b1a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:43.498218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:43.504026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a9b57-5883-4ada-b37c-cea54db13ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:43.504912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9b57-5883-4ada-b37c-cea54db13ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:43.505192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9b57-5883-4ada-b37c-cea54db13ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:43.505468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9b57-5883-4ada-b37c-cea54db13ee9 None admin] PATH_INFO: `/v3/projects/04eb6b658af04bc5b5cb56c007286112/users/f020a2726faf4148aded5bc595d14897/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:43.507468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a9b57-5883-4ada-b37c-cea54db13ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=04eb6b658af04bc5b5cb56c007286112, user_id=f020a2726faf4148aded5bc595d14897, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:43.513481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a9b57-5883-4ada-b37c-cea54db13ee9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:43.600129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 581/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:10:43 2022] PUT /identity/v3/projects/04eb6b658af04bc5b5cb56c007286112/users/f020a2726faf4148aded5bc595d14897/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:10:45.594313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8b683-1e4b-4e10-af11-ae420c8c70ce None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:45.594838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8b683-1e4b-4e10-af11-ae420c8c70ce None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:45.594838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8b683-1e4b-4e10-af11-ae420c8c70ce None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:45.596219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 612/1193] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:10:45.601430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:45.601844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:45.601986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:45.619464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:10:45.620636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:10:45.685121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 582/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:10:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:10:45.708906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8b683-1e4b-4e10-af11-ae420c8c70ce None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:45.738207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:45.806399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8b683-1e4b-4e10-af11-ae420c8c70ce None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:45.838325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:45.839108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:45.839387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:45.839658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:45.850317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:10:45.857850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:10:45.858958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:10:45.860001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 613/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:10:45.864934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:45.961514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f018-073e-48af-91c1-597f40e69689 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:45.981283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:45.995306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:45.996023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:45.996309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:45.996588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:45.997331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:45.997640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:45.999060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:46.006973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 583/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:46.012868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:46.100089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:46.109721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ae82b-b277-4ffd-b24b-7c7b44b3237e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:46.154884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:46.155762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:46.156049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:46.156331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] PATH_INFO: `/v3/users/f020a2726faf4148aded5bc595d14897` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:46.157526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] RBAC: Authorizing `identity:get_user(user_id=f020a2726faf4148aded5bc595d14897)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:46.158997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:46.160632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 614/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jun 20 12:10:46 2022] GET /identity/v3/users/f020a2726faf4148aded5bc595d14897 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:46.167181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:46.264624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c191f-c77b-40c9-8cbd-1543882ab70f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:46.299364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:46.300004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:46.300291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:46.300569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:46.348161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:46.366554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:46.368013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:46.469110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 584/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:10:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:46.474961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:46.569856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b7bc-08b0-42a2-8daa-8baf82305a08 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:46.602106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758e09-6b5b-4a09-ae88-2ead7a386700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:46.603492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758e09-6b5b-4a09-ae88-2ead7a386700 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:46.603769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758e09-6b5b-4a09-ae88-2ead7a386700 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:46.604038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758e09-6b5b-4a09-ae88-2ead7a386700 None admin] PATH_INFO: `/v3/projects/04eb6b658af04bc5b5cb56c007286112` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:46.605198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f758e09-6b5b-4a09-ae88-2ead7a386700 None admin] RBAC: Authorizing `identity:get_project(project_id=04eb6b658af04bc5b5cb56c007286112)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:46.606655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f758e09-6b5b-4a09-ae88-2ead7a386700 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:46.608303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 615/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jun 20 12:10:46 2022] GET /identity/v3/projects/04eb6b658af04bc5b5cb56c007286112 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:46.614306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:10:46.692826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:46.718110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cd7ec-dd48-4c9b-817c-c1e9644534b7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:10:46.751171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:10:46.751815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:10:46.752100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:10:46.752376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:10:46.753197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=04eb6b658af04bc5b5cb56c007286112, user.id=f020a2726faf4148aded5bc595d14897) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:10:46.753507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:10:46.754976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f350-484f-47c8-bf3f-5e261210b289 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:10:46.761181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 585/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:10:46 2022] GET /identity/v3/role_assignments?user.id=f020a2726faf4148aded5bc595d14897&scope.project.id=04eb6b658af04bc5b5cb56c007286112&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:10:56.598081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:56.758059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=27 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:02.949279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94383-da73-41bf-adfc-d051216487cd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:02.949867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94383-da73-41bf-adfc-d051216487cd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:02.949867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94383-da73-41bf-adfc-d051216487cd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:02.951264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 616/1201] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:02.956582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:02.957007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:02.957140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:02.973824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:02.975571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:03.041414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 586/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:03.066198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd94383-da73-41bf-adfc-d051216487cd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:03.168418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd94383-da73-41bf-adfc-d051216487cd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:03.203885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:03.204608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:03.204896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:03.205177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:03.215687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:03.217177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:03.234887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:03.236009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:03.237045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:03.237045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:03.237045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:03.237045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:03.237045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 617/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:03.242382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:03.339047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7803dd-e8fa-4c0d-a4fc-5dc208361b3b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:03.366905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:03.372603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:03.373257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:03.373543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:03.373822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:03.374577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:03.374887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:03.376305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38fc93-aec2-4005-bf2b-f5045eed705a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:03.387328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 587/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:03.393141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:03.445560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:03.499520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c40a9e-f1c9-45cc-94df-0fb30918f387 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:03.533969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad07fb-cae1-4c03-adb5-c6fabb6ff431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:03.534667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad07fb-cae1-4c03-adb5-c6fabb6ff431 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:03.534957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad07fb-cae1-4c03-adb5-c6fabb6ff431 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:03.535243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad07fb-cae1-4c03-adb5-c6fabb6ff431 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:03.535958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad07fb-cae1-4c03-adb5-c6fabb6ff431 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:03.537398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad07fb-cae1-4c03-adb5-c6fabb6ff431 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:03.623068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 618/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jun 20 12:12:03 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:12:05.672784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f85d31-bfd8-4fc5-a73c-459a614dc60a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:05.673335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f85d31-bfd8-4fc5-a73c-459a614dc60a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:05.673335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f85d31-bfd8-4fc5-a73c-459a614dc60a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:05.674778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 588/1206] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:05.680312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:05.680754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:05.680853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:05.697687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:05.698903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:05.766682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 619/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:12:05.793083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f85d31-bfd8-4fc5-a73c-459a614dc60a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:05.893260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f85d31-bfd8-4fc5-a73c-459a614dc60a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:05.927029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:05.927752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:05.928121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:05.928893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:05.938919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:12:05.946676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:05.950841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:05.951897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 589/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:05.953790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:05.993315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:06.050664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0691e92-7781-4940-be3f-06d8ffd73a64 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:06.083766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:06.084435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:06.084724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:06.085008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:06.085754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:06.086096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:06.087459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:06.095144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 620/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:06.101349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:06.151130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:06.200281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a09c-e860-4b2f-b679-38ba1c1ebcaf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:06.232918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:06.233700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:06.233979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:06.234288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:06.244553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:06.246021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:06.262444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:06.264112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:06.265833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:06.265833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:06.265833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:06.265833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:06.265833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 590/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:06.270029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:06.366884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:06.369798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4086b4-1284-4d0f-a57c-69e8bc49be01 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:06.402346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:06.403006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:06.403291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:06.403571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:06.404290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:06.404600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:06.406035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:06.418936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 621/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:12:06.424733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:06.524658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc3a8-712f-4049-98d4-af22ffde4ef8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:06.526186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:06.558479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:06.559275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:06.559576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:06.559840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:06.566630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:06.568077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:12:06.583850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:06.587321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:06.588591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 591/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:06.591637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:06.691075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd32e7-acf7-4cd3-bd9a-2f40850a8a18 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:06.725126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:06.725792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:06.726108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:06.726390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:06.727235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:06.727548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:06.728981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:06.750267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 622/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jun 20 12:12:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:06.757052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:06.855507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085392d9-2d63-459c-9b68-16f7bad9d1de None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:06.889903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:06.890572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:06.890858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:06.891136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:06.921165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:06.958642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:06.960139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:07.056271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 592/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:12:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:12:07.062157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:07.081411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:07.160432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d5f51-1370-4c5a-8ace-76c90b8eb38e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:07.194846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:07.195627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:07.195905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:07.196173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:07.205874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:07.207334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:07.224484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:07.225588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:07.226645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:07.226645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:07.226645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:07.226645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:07.226645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 623/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:07.231363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:07.290716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:07.329418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac614c1-7b48-4404-b0ab-2b96aec05755 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:07.361630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:07.362304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:07.362586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:07.362858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:07.363567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:07.363867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:07.365288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:07.377121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 593/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:07.382649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:07.450797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:07.479423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1268bc-1a92-4acf-98ee-0a72c7dd1c5e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:07.513463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:07.514349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:07.514633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:07.514906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:07.521426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:07.522923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:12:07.536080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:07.537128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:07.538787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 624/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:07.543836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:07.643238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f421bc-2301-4b27-8961-ffd1f174fa84 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:07.665979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:07.677209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:07.677869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:07.678711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:07.679003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:07.679789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:07.680094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:07.684389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb0ca-8c82-4630-9dff-5fd9a8706a6d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:07.692651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 594/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:07.699349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:07.798480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5bdb-8d8a-499a-91ce-6c126a1936af None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:07.826661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:07.832305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:07.832948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:07.833234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:07.833509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:07.834390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=c51168ff1c1f42e781051ace1af97dd4) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:07.839153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:07.839153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab985c1-0133-43fb-a389-da51db79696f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:07.841936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 625/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:12:07 2022] GET /identity/v3/role_assignments?user.id=c51168ff1c1f42e781051ace1af97dd4&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:09.837075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0fd7-c532-40c8-96a2-53526c933a8f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:09.837628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0fd7-c532-40c8-96a2-53526c933a8f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:09.837628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0fd7-c532-40c8-96a2-53526c933a8f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:09.839068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 595/1220] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:09.844338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:09.844747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:09.844903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:09.862085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:09.863276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:09.928753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 626/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:09.951937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b0fd7-c532-40c8-96a2-53526c933a8f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:10.054793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b0fd7-c532-40c8-96a2-53526c933a8f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:10.087532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:10.088248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:10.088532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:10.088806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:10.099162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:12:10.107599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:10.108592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:10.109441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 596/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:10.115271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:10.216690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c9397-ad8b-4c64-bd75-892ee6014f83 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:10.239753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:10.249929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:10.250632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:10.250902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:10.251176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:10.251918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:10.252223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:10.253602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:10.261185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 627/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:10.267089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:10.311168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:10.365813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3f73-d26e-4690-96e3-8ebab321f3d0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:10.398462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:10.399237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:10.399515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:10.399791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:10.409839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:10.411404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:10.428159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:10.429238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:10.430367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:10.430367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:10.430367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:10.430367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:10.430367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 597/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:10.435485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:10.535867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77c17-127c-48ce-a662-43c366f17ee0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:10.570798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:10.571457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:10.571740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:10.572014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:10.572733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:10.573040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:10.574441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:10.586551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 628/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:10.592316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:10.683263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:10.690662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1631601-87a8-4b2d-98e6-85be3392fc61 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:10.723704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:10.724529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:10.725045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:10.725500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:10.732736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:10.734205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:12:10.749195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:10.750320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:10.751483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 598/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:10.756183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:10.814275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:10.864568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde540-8bd4-460b-ac8a-e604585a7622 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:10.897811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:10.898505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:10.898795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:10.899075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:10.899906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:10.900220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:10.901666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:10.918489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 629/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jun 20 12:12:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:10.924462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:11.025712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a50e0-e774-486b-867f-ac6a4bb76a06 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:11.060330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:11.061111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:11.061394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:11.061671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:11.072084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:11.073587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:11.091356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:11.092541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:11.093505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:11.093505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:11.093505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:11.093505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:11.093505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 599/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:12:11.098441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:11.198157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c642ed-bedc-4ea4-af41-304940d6ffdb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:11.202357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:11.232351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:11.233166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:11.233668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:11.233951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:11.234697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:11.237432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:11.237432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:11.247418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 630/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:11.253186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:11.262639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:11.351622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507a9a-a96e-4623-86a1-976116171f81 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:11.384911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:11.385680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:11.385972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:11.386277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:11.392777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:11.394264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:12:11.408762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:11.411832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:11.412743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 600/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:11.416128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:11.515211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76825eb0-8595-49da-9ad1-63587ddbfb31 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:11.548098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:11.548751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:11.549033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:11.549317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:11.550143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:11.550457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:11.551888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29da55c-1ef0-4bf6-84af-c8b859273444 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:11.564025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 631/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:11.570784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:11.635543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:11.668862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea8e0-1c85-4ae5-b91d-c48fee8c4ce6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:11.701641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea925-5d90-4544-85e7-d3840b4d6273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:11.702541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea925-5d90-4544-85e7-d3840b4d6273 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:11.702824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea925-5d90-4544-85e7-d3840b4d6273 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:11.703101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea925-5d90-4544-85e7-d3840b4d6273 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/c51168ff1c1f42e781051ace1af97dd4/roles/1372d59a31814a1ca457361eeac22970` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:11.716845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ea925-5d90-4544-85e7-d3840b4d6273 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=c51168ff1c1f42e781051ace1af97dd4, role_id=1372d59a31814a1ca457361eeac22970)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:11.718342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ea925-5d90-4544-85e7-d3840b4d6273 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:11.834659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 601/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:12:11 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/c51168ff1c1f42e781051ace1af97dd4/roles/1372d59a31814a1ca457361eeac22970 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:12:13.874621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c99215-d15c-4bc7-b2c7-c6786d7ed6a3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:13.875174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c99215-d15c-4bc7-b2c7-c6786d7ed6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:13.875174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c99215-d15c-4bc7-b2c7-c6786d7ed6a3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:13.876529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 632/1233] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:13.881878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:13.882330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:13.882466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:13.899341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:13.900532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:13.966318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 602/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:12:13.990413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c99215-d15c-4bc7-b2c7-c6786d7ed6a3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:14.015279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:14.090521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c99215-d15c-4bc7-b2c7-c6786d7ed6a3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:14.123050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:14.123848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:14.124136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:14.124447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:14.137421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:12:14.142697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:14.143821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:14.144729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 633/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jun 20 12:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:14.150507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:14.196165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:14.247280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24813ddb-b26d-4797-8d5a-bad7edd0359e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:14.280411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:14.281076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:14.281363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:14.281646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:14.282471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:14.282773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:14.284156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:14.292184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 603/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jun 20 12:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:14.298135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:14.380440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:14.396382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7653-2e9a-4f4f-85c2-b4e6aeceb468 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:14.429907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:14.430716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:14.430996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:14.431267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:14.441303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:14.442848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:14.459743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:14.460694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:14.461639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:14.461639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:14.461639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:14.461639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:14.461639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 634/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:14.466841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:14.566660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d049093-de3d-4154-9349-3e826a099c98 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:14.575877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:14.599909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:14.600595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:14.600880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:14.601176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:14.601895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:14.602243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:14.603624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:14.614924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 604/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:14.621214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:14.721106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3110258-f8b8-4fe8-8f6e-6d327dbcf4d8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:14.754373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:14.755168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:14.755453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:14.755731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:14.759057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:14.764155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:14.765604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:12:14.779595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:14.780562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:14.782046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 635/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:14.786723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:14.892388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6a0ac-7179-4318-a41e-d6eeb5b056ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:14.926317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:14.926969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:14.927248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:14.927520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:14.928340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:14.928645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:14.930658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:14.947092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 605/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jun 20 12:12:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:12:14.952863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:15.059107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee85-2941-495f-85e1-7c8949c3b6f8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:15.091808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:15.092460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:15.092746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:15.093029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:15.154496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:15.160885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:15.162443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:15.274992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 636/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:12:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:12:15.281033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:15.309230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:15.378328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d845-ff15-483d-ac1c-fa785e6feac2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:15.411717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:15.412489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:15.412772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:15.413046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:15.423682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:15.425129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:15.441964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:15.443054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:15.444288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:15.444288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:15.444288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:15.444288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:15.444288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 606/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:15.448863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:15.550785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:15.557069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace21c-509c-4b39-9af1-b12746fc6fa7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:15.594410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:15.594977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:15.595257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:15.595532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:15.596245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:15.596553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:15.597912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:15.609717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 637/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:15.616762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:15.693013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:15.715401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b564-a476-4b84-86f3-e9f79f45ad1a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:15.748074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:15.748849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:15.749133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:15.749408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:15.755865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:15.757819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:12:15.772037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:15.773668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:15.774655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 607/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:15.779805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:15.877127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2dc61-ba93-4abe-bf31-187fd19446a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:15.912120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:15.912786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:15.913135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:15.913417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:15.914266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:15.914576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:15.916320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c4c1-c602-4b3a-8ac6-80f75b61b823 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:15.928275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 638/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:15.934809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:16.033418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a706e2-725c-4e40-9c0f-d544b99180ea None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:16.066594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:16.067236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:16.067521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:16.067799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:16.068619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] RBAC: Adding query filter params (role.id=1372d59a31814a1ca457361eeac22970, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=c51168ff1c1f42e781051ace1af97dd4) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:16.068938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:16.071055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc64c3-712d-4445-8773-9e25da8e0b2a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:16.076788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 608/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:12:15 2022] GET /identity/v3/role_assignments?user.id=c51168ff1c1f42e781051ace1af97dd4&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=1372d59a31814a1ca457361eeac22970 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:18.174632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a881-c7da-4412-89cf-8e379c834f15 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:18.175131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a881-c7da-4412-89cf-8e379c834f15 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:18.175242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a881-c7da-4412-89cf-8e379c834f15 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:18.176591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 639/1247] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:18.181794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:18.182212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:18.182389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:18.187555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:18.199527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:18.204488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:18.266508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 609/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:18.291694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a881-c7da-4412-89cf-8e379c834f15 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:18.309510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:18.390216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a881-c7da-4412-89cf-8e379c834f15 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:18.423582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:18.424372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:18.424660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:18.424938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:18.435117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:12:18.443654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:18.445568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:18.446533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 640/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:18.450983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:18.548725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e858b2c-f8dd-4363-9c74-46212e3b3acd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:18.578234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:18.583125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:18.583795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:18.584092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:18.584370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:18.585118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:18.589266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:18.589266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:18.599749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 610/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:18.605692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:18.684367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:18.707317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1711-8f46-4d42-bda6-698022d1b188 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:18.740524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:18.741311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:18.741598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:18.741892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:18.753100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:18.754606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:18.771784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:18.772816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:18.774439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:18.774439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:18.774439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:18.774439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:18.774439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 641/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:12:18.779513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:18.887347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903ff2-71fa-43f2-b733-08962179a2b3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:18.921181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:18.921839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:18.922156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:18.922435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:18.923152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:18.923461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:18.924833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:18.937002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 611/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:18.942758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:19.039801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a85c-786b-488d-beab-4fbc34a0d899 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:19.065404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:19.073606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:19.074486 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:19.074768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:19.075043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:19.082312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:19.083749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:12:19.097866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:19.099030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:19.100015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 642/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:19.105076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:19.160527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:19.208476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b547-05a2-4c94-aff8-c5af30b373e0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:19.240344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:19.241005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:19.241288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:19.242071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:19.242920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:19.243224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:19.244676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:19.261716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 612/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jun 20 12:12:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:19.267657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:19.367195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e276e-27db-4611-b4c5-220f9072cf01 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:19.399663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:19.400342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:19.400635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:19.400920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:19.455227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:19.467058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:19.468463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:19.564732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 643/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:12:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:12:19.570618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:19.668082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d61fed-7c83-43ba-ae70-c721f451569e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:19.680877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:19.703389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:19.704219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:19.704503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:19.704776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:19.715107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:19.716536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:19.734375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:19.735236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:19.736217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:19.736217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:19.736217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:19.736217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:19.736217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 613/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:19.741204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:19.825390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:19.837242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6854a-fad0-45e0-a2f1-67b4f3f5e815 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:19.870786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:19.871488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:19.872117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:19.872403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:19.873128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:19.873432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:19.874878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:19.886127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 644/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:19.891731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:19.990649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394bf10-567c-4c3d-9661-4989e50755e5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:20.023903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:20.024688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:20.029441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:20.029441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:20.031896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:20.033346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:12:20.047719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:20.048761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:20.049799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 614/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:20.054924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:20.154675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3558-cbed-457e-a9b6-aec7ec5a18a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:20.187573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:20.188233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:20.188521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:20.188798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:20.189584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:20.189895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:20.191351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31d8d0-3b60-4220-9af4-b8725ca95dd5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:20.206065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 645/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:12:20.215719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:20.242916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:20.314881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e558a-eee6-4d58-ad8b-da8d0e641c40 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:20.348448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:20.349090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:20.358617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:20.358617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:20.358617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=c51168ff1c1f42e781051ace1af97dd4) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:20.358617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:20.358617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3805b-1586-46fe-8d17-186dffe28068 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:20.359032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 615/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:12:20 2022] GET /identity/v3/role_assignments?user.id=c51168ff1c1f42e781051ace1af97dd4&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:22.361270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87e855-d7aa-4fb6-ae1b-7193ab64f6dd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:22.361829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87e855-d7aa-4fb6-ae1b-7193ab64f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:22.361829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87e855-d7aa-4fb6-ae1b-7193ab64f6dd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:22.363218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 646/1261] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:22.369799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:22.369799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:22.369799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:22.385906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:22.387124 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:22.453042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 616/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:22.475823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87e855-d7aa-4fb6-ae1b-7193ab64f6dd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:22.487218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:22.575518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87e855-d7aa-4fb6-ae1b-7193ab64f6dd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:22.609051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:22.609834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:22.610190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:22.610471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:22.621016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:12:22.628637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:22.629638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:22.630723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 647/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:22.635995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:22.654770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:22.731404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b3cb9-a8ca-4af9-9f72-17e78f7349a5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:22.764593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:22.765260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:22.765546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:22.765826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:22.766605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:22.766916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:22.768303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:22.776767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 617/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:22.782521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:22.848713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:22.882309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66816-ae4c-4d38-adb8-aa670d7a5253 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:22.922559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:22.923355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:22.923640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:22.923922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:22.934707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:22.936231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:22.952921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:22.953965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:22.955103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:22.955103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:22.955103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:22.955103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:22.955103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 648/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:22.959995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.040592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:23.058667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47775abe-6d71-4d43-ba90-85e75ba7416e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:23.091919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:23.092572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:23.092858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:23.093137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:23.093850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:23.094215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:23.095611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:23.106754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 618/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:23.112264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.212202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94348c1-ea16-49d9-91d3-b7fc45dbef11 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:23.231233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:23.244596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:23.245379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:23.245658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:23.245928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:23.253170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:23.254642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:12:23.268931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:23.274316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:23.275563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 649/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:23.277275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.377802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb605d-3151-4793-9d92-924989202e25 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:23.411081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:23.411734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:23.412014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:23.412289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:23.413107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:23.413711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:23.415180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:23.424179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:23.432457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 619/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jun 20 12:12:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:23.437960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.535881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67192dc0-7415-46c8-8ab0-bdbcc9a9a732 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:23.569274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:23.570624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:23.570905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:23.571181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:23.581419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:23.582901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:23.599389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:23.600444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:23.601681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:23.601681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:23.601681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:23.601681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:23.601681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 650/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:23.606462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.706707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933df03d-7037-487c-8e74-340ce075db52 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:23.740366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:23.741021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:23.741307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:23.742145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:23.742913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:23.743227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:23.744599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:23.755527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 620/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:23.762054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.794466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:23.860257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b401-2891-4ad9-b38b-7a407b88057c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:23.893010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:23.893795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:23.894107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:23.894389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:23.900946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:23.902424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:12:23.917070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:23.923288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:23.924216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 651/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:23.924777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:23.980960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:24.020269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539194-ba69-45f4-8248-8dc5fb6da6e3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:24.052510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:24.053085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:24.053361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:24.053630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:24.054985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:24.055290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:24.056744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b7e3e-cee6-4daa-be19-29a02d2d8b90 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:24.068050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 621/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:12:24.074175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:24.164097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:24.172806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58907ba7-a0ba-4e1f-af78-492ce7172b45 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:24.205848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ff963-df43-43a5-80d2-e80caf4386a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:24.206760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ff963-df43-43a5-80d2-e80caf4386a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:24.207048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ff963-df43-43a5-80d2-e80caf4386a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:24.207329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ff963-df43-43a5-80d2-e80caf4386a0 None admin] PATH_INFO: `/v3/projects/8784149a72314664ba0a379404d0c257/users/c51168ff1c1f42e781051ace1af97dd4/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:24.209277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ff963-df43-43a5-80d2-e80caf4386a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8784149a72314664ba0a379404d0c257, user_id=c51168ff1c1f42e781051ace1af97dd4, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:24.210764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ff963-df43-43a5-80d2-e80caf4386a0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:24.406239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 652/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jun 20 12:12:24 2022] PUT /identity/v3/projects/8784149a72314664ba0a379404d0c257/users/c51168ff1c1f42e781051ace1af97dd4/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:12:26.403096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e63741-0a68-4a89-a488-23cc862bbd6e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:26.403912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e63741-0a68-4a89-a488-23cc862bbd6e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:26.403912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e63741-0a68-4a89-a488-23cc862bbd6e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:26.405107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 622/1274] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:26.410507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:26.411446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:26.412734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:26.428270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:26.429950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:26.494934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 653/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:26.518730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e63741-0a68-4a89-a488-23cc862bbd6e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:26.617751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e63741-0a68-4a89-a488-23cc862bbd6e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:26.635327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:26.651479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:26.652252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:26.652534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:26.652809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:26.666950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:12:26.670290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:26.671401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:26.672316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 623/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jun 20 12:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:26.677450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:26.759274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:26.776790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1adf-1f0e-4fa3-9521-5b4e6511b439 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:26.810358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:26.811024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:26.811313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:26.811593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:26.812344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:26.812654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:26.814050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:26.822038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 654/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jun 20 12:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:26.827772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:26.927027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f95e-c736-4c8c-af72-3b599df48653 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:26.961401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:26.962210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:26.962495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:26.962771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:26.973639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:26.975214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:26.993055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:26.994026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:26.994999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:26.994999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:26.994999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:26.994999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:26.994999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 624/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:27.000060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:27.100173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeebe9-a00d-4cc5-b265-5c98eb1fe349 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:27.134466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:27.135134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:27.135423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:27.135716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:27.136428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:27.136739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:27.138149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:27.150586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 655/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:27.156216 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:27.187969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:27.255105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b592-47da-4fe7-b80c-461843f06b8c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:27.289921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:27.291017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:27.291284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:27.291556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:27.298511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:27.299958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:12:27.314676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:27.315809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:27.316764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 625/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:27.322280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:27.326075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:27.419680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae934-f080-4317-a8ea-0a2f30858499 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:27.454892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:27.455548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:27.455835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:27.456114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:27.456948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:27.457261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:27.458735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:27.475499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 656/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jun 20 12:12:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:27.481550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:27.571617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:27.581114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e95f9f-d1ec-4a54-847b-4311c9a0fdca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:27.615183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:27.615824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:27.616120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:27.616386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:27.683136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:27.684644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:27.771208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:27.781165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 626/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jun 20 12:12:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:12:27.787141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:27.848441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:27.886148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534f832-cbad-41e3-b605-f96b35288316 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:27.919890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:27.920701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:27.920972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:27.921254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:27.934949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:27.936439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:12:27.965345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:27.966436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:27.967548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:12:27.967548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:12:27.967548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:12:27.967548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:27.967548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 657/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:27.972432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:28.071365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f0ae5-65ab-4b49-928e-ee6962ef3086 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:28.104138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:28.104800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:28.105088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:28.105366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:28.106119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:28.106432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:28.107820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:28.119781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 627/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jun 20 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:28.125456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:28.223299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4b331-defc-4323-b9e4-8394e0ac6035 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:28.236850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:28.256485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:28.257891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:28.258217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:28.258496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:28.265060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:28.266548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:12:28.280464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:28.281504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 20 12:12:28.282726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 658/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jun 20 12:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:28.287616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:28.346641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:28.396734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b39b-062c-447f-a60f-e967b7ec43a1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:28.430916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:28.431562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:28.431849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:28.432131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:28.432914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:28.433225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:28.434700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7db1b-dd2a-4479-b1ac-bdcbd0848612 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:28.446545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 628/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jun 20 12:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:28.452949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:28.553514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b3333-cbb2-4cd4-a843-0b03b4980032 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:28.588196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:28.588847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:28.589239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:28.589517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:28.590404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] RBAC: Adding query filter params (role.id=06eae323e9d94a719e6100f2cbfb1003, scope.project.id=8784149a72314664ba0a379404d0c257, user.id=c51168ff1c1f42e781051ace1af97dd4) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:28.590710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:28.592137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf14fc-a75d-4e55-b775-be94279c399a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:28.601732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 659/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jun 20 12:12:28 2022] GET /identity/v3/role_assignments?user.id=c51168ff1c1f42e781051ace1af97dd4&scope.project.id=8784149a72314664ba0a379404d0c257&role.id=06eae323e9d94a719e6100f2cbfb1003 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:30.645019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e145-9f13-4949-81a4-b251e93f5c83 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:30.645728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e145-9f13-4949-81a4-b251e93f5c83 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:30.645728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6e145-9f13-4949-81a4-b251e93f5c83 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:30.647000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 629/1288] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:30.652584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:30.653036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:30.653135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:30.670725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:30.671907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:30.701786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:30.738498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 660/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:30.761612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6e145-9f13-4949-81a4-b251e93f5c83 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:30.861783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6e145-9f13-4949-81a4-b251e93f5c83 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:30.873571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:30.896168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:30.896964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:30.897249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:30.897528 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:30.898710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:30.900089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:30.911855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:30.913154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:30.914697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 630/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:12:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:30.919890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:31.053855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c707b-b1e7-4417-908e-01ca0d498c90 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:31.087154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:31.087810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:31.088091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:31.088364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:31.089059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:31.089361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:31.090740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bff5d-8dc0-48e6-92f4-dd0d4342ae2d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:31.095493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 661/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jun 20 12:12:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:31.102044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:31.202137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d35c5-ba72-480b-9a77-d79ba32ce14b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:31.234954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:31.240138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:31.240138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:31.240138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:31.240138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:31.240138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:31.240138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362be2-3c00-4075-bcd6-17ee97ffe373 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:31.243627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 631/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jun 20 12:12:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:33.270542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24690-d17e-4800-a8b6-96a696e1ba82 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:33.271091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24690-d17e-4800-a8b6-96a696e1ba82 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:33.271091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24690-d17e-4800-a8b6-96a696e1ba82 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:33.272499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 662/1293] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:33.277753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f0d3-6595-4a77-9fba-dfa498b15262 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:33.278229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f0d3-6595-4a77-9fba-dfa498b15262 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:33.278326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f0d3-6595-4a77-9fba-dfa498b15262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:33.295477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-53e0f0d3-6595-4a77-9fba-dfa498b15262 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:33.296666 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-53e0f0d3-6595-4a77-9fba-dfa498b15262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:33.328437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:33.364320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 632/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:12:33.391191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da24690-d17e-4800-a8b6-96a696e1ba82 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:33.418727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:33.486480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da24690-d17e-4800-a8b6-96a696e1ba82 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:33.519385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4827631-afdc-4587-866f-8cb60ab14b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:33.520046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827631-afdc-4587-866f-8cb60ab14b30 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:33.520335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827631-afdc-4587-866f-8cb60ab14b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:33.520616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827631-afdc-4587-866f-8cb60ab14b30 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:33.521694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827631-afdc-4587-866f-8cb60ab14b30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:33.523140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827631-afdc-4587-866f-8cb60ab14b30 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:33.650996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 663/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jun 20 12:12:33 2022] POST /identity/v3/services => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:12:35.680714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778640aa-86a2-4bd9-a9c5-7e9d5ae5cd70 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:35.681262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778640aa-86a2-4bd9-a9c5-7e9d5ae5cd70 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:35.681262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778640aa-86a2-4bd9-a9c5-7e9d5ae5cd70 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:35.682663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 633/1296] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:35.687678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:35.688065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:35.688224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:35.705194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:35.706399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:35.777061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 664/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:35.800069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778640aa-86a2-4bd9-a9c5-7e9d5ae5cd70 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:35.899011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778640aa-86a2-4bd9-a9c5-7e9d5ae5cd70 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:35.937024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:35.937024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:35.937024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:35.937024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:35.937392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:35.937392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:35.947812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:35.949080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:35.950140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 634/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:12:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:12:35.955110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:35.973906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:36.078361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe44a6-7b19-4b26-a33c-565536e1d280 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:36.111419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:36.112102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:36.113504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:36.113504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:36.113504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:36.130828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:36.130828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:36.130828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 665/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jun 20 12:12:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:36.134089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:36.164160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:36.237227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fdba7-882d-44bd-a38d-3e7c3a0cda1c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:36.275515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:36.276173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:36.276457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:36.276732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:36.277524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] RBAC: Adding query filter params (interface=public, service_id=630302e9232e40ba888e249d3313c3ba, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:36.277842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:36.279248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef4ec7-81cf-476d-acf6-9f096d131f7f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:36.285362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 635/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jun 20 12:12:36 2022] GET /identity/v3/endpoints?service_id=630302e9232e40ba888e249d3313c3ba&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:36.292672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:36.394072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:36.411655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf02232-3797-4b43-8bba-55573370062e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:36.446955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191adf36-1434-446a-aa94-b1268eef4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:36.447734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191adf36-1434-446a-aa94-b1268eef4b67 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:36.448017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191adf36-1434-446a-aa94-b1268eef4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:36.448298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191adf36-1434-446a-aa94-b1268eef4b67 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:36.448985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191adf36-1434-446a-aa94-b1268eef4b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:36.450440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191adf36-1434-446a-aa94-b1268eef4b67 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:36.457300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 666/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jun 20 12:12:36 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:12:38.543189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541040-9b56-4858-aa3b-565a0f8e8cc1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:38.543761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541040-9b56-4858-aa3b-565a0f8e8cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:38.543761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541040-9b56-4858-aa3b-565a0f8e8cc1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:38.545135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 636/1302] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:12:38.550446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:38.550860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:38.551010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:38.567634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:12:38.568816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:12:38.634519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 667/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:12:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:12:38.657688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541040-9b56-4858-aa3b-565a0f8e8cc1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:38.750462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:38.757484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541040-9b56-4858-aa3b-565a0f8e8cc1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:38.790578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:38.791619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:38.791904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:38.792182 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:38.792836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:38.794289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:12:38.806393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:12:38.807585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 20 12:12:38.808794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 637/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jun 20 12:12:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:12:38.813617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:38.888417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:38.910120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bab38-75b9-432d-9641-e647a433d8c6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:38.943245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:38.943904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:38.944192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:38.944476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:38.945183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:12:38.945495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:38.946933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954463e1-31f4-4e82-98be-9db819450e69 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:38.952019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 668/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jun 20 12:12:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:12:38.957806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:12:39.056228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b42180-27d4-4f30-8fa7-176a4a8a4c18 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:12:39.088863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec184eb-cecb-49c1-9438-02a38105634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:12:39.089506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec184eb-cecb-49c1-9438-02a38105634f None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:12:39.089787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec184eb-cecb-49c1-9438-02a38105634f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:12:39.090145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec184eb-cecb-49c1-9438-02a38105634f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:12:39.090876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec184eb-cecb-49c1-9438-02a38105634f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:12:39.092255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec184eb-cecb-49c1-9438-02a38105634f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:12:39.205848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 638/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jun 20 12:12:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:12:49.005421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=30 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:49.201055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:21.575124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ab88-55b1-4ce9-a70c-c9f09b76da0a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:21.576023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ab88-55b1-4ce9-a70c-c9f09b76da0a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:21.576447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ab88-55b1-4ce9-a70c-c9f09b76da0a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:21.578012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 669/1307] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:19:21.583337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e83ef-dad3-4436-9f4c-5242d4aed80b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:21.584169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e83ef-dad3-4436-9f4c-5242d4aed80b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:21.584658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e83ef-dad3-4436-9f4c-5242d4aed80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:21.660200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bf2e83ef-dad3-4436-9f4c-5242d4aed80b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:21.661906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf2e83ef-dad3-4436-9f4c-5242d4aed80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:21.794453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 639/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:21.830795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396822e-3be4-4620-ad03-177930f377b7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:21.831427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396822e-3be4-4620-ad03-177930f377b7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:21.831427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396822e-3be4-4620-ad03-177930f377b7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:21.832968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 670/1309] 10.222.0.70 () {54 vars in 964 bytes} [Mon Jun 20 12:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:21.839182 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad838b2-f46b-4944-ac9c-d31ab666e536 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:21.839478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad838b2-f46b-4944-ac9c-d31ab666e536 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:21.839759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad838b2-f46b-4944-ac9c-d31ab666e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:21.934820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-aad838b2-f46b-4944-ac9c-d31ab666e536 None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:21.935316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-aad838b2-f46b-4944-ac9c-d31ab666e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:21.957531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:22.024045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396822e-3be4-4620-ad03-177930f377b7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:22.025808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9396822e-3be4-4620-ad03-177930f377b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:22.030562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 640/1310] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Jun 20 12:19:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:19:22.216880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396822e-3be4-4620-ad03-177930f377b7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:22.304386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:22.305030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:22.305325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:22.305607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:22.307433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:22.376241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:22.440999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:22.442517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa22c51-47a4-4b81-afdc-8e3af7a726fe service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:22.466524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 671/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:19:24.841643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031893-ada6-4bf0-ae4b-ca5549356c1f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:24.842246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031893-ada6-4bf0-ae4b-ca5549356c1f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:24.842246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031893-ada6-4bf0-ae4b-ca5549356c1f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:24.843598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 641/1312] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:24.848798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b50ec-19c1-447a-8b32-87d6325ef869 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:24.849204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b50ec-19c1-447a-8b32-87d6325ef869 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:24.849386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b50ec-19c1-447a-8b32-87d6325ef869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:24.928470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ad3b50ec-19c1-447a-8b32-87d6325ef869 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:24.929673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ad3b50ec-19c1-447a-8b32-87d6325ef869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:25.024346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 672/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:25.063627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92031893-ada6-4bf0-ae4b-ca5549356c1f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:25.065175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-92031893-ada6-4bf0-ae4b-ca5549356c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:25.172008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92031893-ada6-4bf0-ae4b-ca5549356c1f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:25.242866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:25.245445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:25.246100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:25.246389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:25.246664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:25.248301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:25.356286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:25.357729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929adc0-ae6b-4a50-81a7-796603ecda04 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:25.375323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 642/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:27.928424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f814a5-c244-4b8d-9d12-5fc04f260f12 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:27.928920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f814a5-c244-4b8d-9d12-5fc04f260f12 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:27.929008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f814a5-c244-4b8d-9d12-5fc04f260f12 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:27.930433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 673/1315] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:27.936212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64460508-b87b-4cbe-8a2d-3c1463b1375e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:27.936580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64460508-b87b-4cbe-8a2d-3c1463b1375e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:27.936777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64460508-b87b-4cbe-8a2d-3c1463b1375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:28.000049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-64460508-b87b-4cbe-8a2d-3c1463b1375e None None] MFA Rules not processed for user `42d160b5b22a4fd0afc9965b94569b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:28.001248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-64460508-b87b-4cbe-8a2d-3c1463b1375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:28.051737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:28.096233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 643/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:28.135274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f814a5-c244-4b8d-9d12-5fc04f260f12 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:28.137341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71f814a5-c244-4b8d-9d12-5fc04f260f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:28.149833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:28.247181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f814a5-c244-4b8d-9d12-5fc04f260f12 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:28.319533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:28.320178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:28.320461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:28.320737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:28.322420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:28.388785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:28.436588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:28.438104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278f01a-1f3d-4408-8269-c88d6b747ade service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:28.456993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 674/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:31.251497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c27d27-8882-4bd3-8575-8637dd4fb53d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:31.252019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c27d27-8882-4bd3-8575-8637dd4fb53d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:31.252137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c27d27-8882-4bd3-8575-8637dd4fb53d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:31.253424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 644/1318] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:31.258545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cd97-ff48-4010-bf88-e47f198a7151 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:31.258965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cd97-ff48-4010-bf88-e47f198a7151 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:31.259115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cd97-ff48-4010-bf88-e47f198a7151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:31.323232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3a54cd97-ff48-4010-bf88-e47f198a7151 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:31.325021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a54cd97-ff48-4010-bf88-e47f198a7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:31.419019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 675/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:31.458519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c27d27-8882-4bd3-8575-8637dd4fb53d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:31.460126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a9c27d27-8882-4bd3-8575-8637dd4fb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:31.563358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c27d27-8882-4bd3-8575-8637dd4fb53d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:31.635457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:31.636095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:31.636419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:31.636656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:31.638323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:31.645078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:31.749936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:31.751345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fced5c1-b0cb-4fff-b45d-a543ab8d6673 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:31.769695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 645/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:34.810503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80747-98c9-4e7e-b950-a349c4b35adf None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:34.811067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80747-98c9-4e7e-b950-a349c4b35adf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:34.811067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80747-98c9-4e7e-b950-a349c4b35adf None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:34.812437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 676/1321] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:34.817672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fc1e7-bfea-47b3-ad7e-b66badf47a4a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:34.818158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fc1e7-bfea-47b3-ad7e-b66badf47a4a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:34.818282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fc1e7-bfea-47b3-ad7e-b66badf47a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:34.882661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-698fc1e7-bfea-47b3-ad7e-b66badf47a4a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:34.883871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-698fc1e7-bfea-47b3-ad7e-b66badf47a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:34.944267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:34.983446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 646/1322] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:35.021648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80747-98c9-4e7e-b950-a349c4b35adf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:35.023251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-34c80747-98c9-4e7e-b950-a349c4b35adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:35.043822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:35.137412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80747-98c9-4e7e-b950-a349c4b35adf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:35.213816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:35.214491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:35.214796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:35.215067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:35.216691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:35.287058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:35.326579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:35.328014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafeb7e-708a-47ae-91ce-9772dac7cd70 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:35.345491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 677/1323] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:37.435690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ac08-3b89-46de-8efb-b18ad8f316e1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:37.436219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ac08-3b89-46de-8efb-b18ad8f316e1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:37.436219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ac08-3b89-46de-8efb-b18ad8f316e1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:37.437767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 647/1324] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:19:37.443093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47c49-ceb0-4c7d-a959-ecf206b347d6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:37.443575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47c49-ceb0-4c7d-a959-ecf206b347d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:37.443720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47c49-ceb0-4c7d-a959-ecf206b347d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:37.509140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6fa47c49-ceb0-4c7d-a959-ecf206b347d6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:37.510308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6fa47c49-ceb0-4c7d-a959-ecf206b347d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:37.610339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 678/1325] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:37.660688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9c86-407c-442e-a4f1-24c18a733126 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:37.660975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9c86-407c-442e-a4f1-24c18a733126 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:37.661252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9c86-407c-442e-a4f1-24c18a733126 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:37.662677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 648/1326] 10.222.0.70 () {54 vars in 964 bytes} [Mon Jun 20 12:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:37.669200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486e37-fa20-4ba7-9a55-604de726f20f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:37.669485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486e37-fa20-4ba7-9a55-604de726f20f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:37.669763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486e37-fa20-4ba7-9a55-604de726f20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:37.700220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:37.744346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b2486e37-fa20-4ba7-9a55-604de726f20f None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:37.745529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2486e37-fa20-4ba7-9a55-604de726f20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:37.823500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 679/1327] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Jun 20 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:37.832652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a9c86-407c-442e-a4f1-24c18a733126 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:37.834270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-221a9c86-407c-442e-a4f1-24c18a733126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:37.944884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a9c86-407c-442e-a4f1-24c18a733126 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:38.017422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:38.017983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:38.018288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:38.018560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:38.020191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:38.037159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:38.141632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:38.143229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e6077-845c-402b-9f84-2e3a506b2f9d service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:38.161886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 649/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:40.475959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae77fa-a142-4b55-bc2d-478c5bbc6f9e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:40.476495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae77fa-a142-4b55-bc2d-478c5bbc6f9e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:40.476495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae77fa-a142-4b55-bc2d-478c5bbc6f9e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:40.477912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 680/1329] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:40.483048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8708-f4c2-4e99-91cf-7f84ff03d963 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:40.483469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8708-f4c2-4e99-91cf-7f84ff03d963 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:40.483612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8708-f4c2-4e99-91cf-7f84ff03d963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:40.550468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-56ea8708-f4c2-4e99-91cf-7f84ff03d963 None None] MFA Rules not processed for user `42d160b5b22a4fd0afc9965b94569b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:40.551672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-56ea8708-f4c2-4e99-91cf-7f84ff03d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:40.615142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:40.646856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 650/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:19:40.688209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae77fa-a142-4b55-bc2d-478c5bbc6f9e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:40.689736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-96ae77fa-a142-4b55-bc2d-478c5bbc6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:40.803841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae77fa-a142-4b55-bc2d-478c5bbc6f9e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:40.824512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:40.878390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:40.879038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:40.879318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:40.879592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:40.881208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:41.055720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:41.055720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3790-c673-4b76-b233-8c93ccbc9beb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:41.055720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 681/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:43.776166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea179c-1eb7-4da7-8f84-777621506fa0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:43.777087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea179c-1eb7-4da7-8f84-777621506fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:43.777087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea179c-1eb7-4da7-8f84-777621506fa0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:43.778679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 651/1332] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:43.783782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245459-a5fc-41d7-b342-44584af05595 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:43.784204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245459-a5fc-41d7-b342-44584af05595 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:43.784345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245459-a5fc-41d7-b342-44584af05595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:43.847690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:43.850643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7c245459-a5fc-41d7-b342-44584af05595 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:43.851871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7c245459-a5fc-41d7-b342-44584af05595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:43.971792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 682/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:44.010807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea179c-1eb7-4da7-8f84-777621506fa0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:44.010807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2bea179c-1eb7-4da7-8f84-777621506fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:44.112092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea179c-1eb7-4da7-8f84-777621506fa0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:44.185467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:44.186140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:44.186425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:44.186706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:44.188383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:44.214473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:44.300266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:44.301719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e856046-b515-42cb-98e9-5c0bd1d1bac4 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:44.324465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 652/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:46.393141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac8070-63f9-4ed8-abe6-9e110b68c7e6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:46.393646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac8070-63f9-4ed8-abe6-9e110b68c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:46.393646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac8070-63f9-4ed8-abe6-9e110b68c7e6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:46.395142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 683/1335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:46.400370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d585-bedd-47de-a621-077cd9e50e4e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:46.400795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d585-bedd-47de-a621-077cd9e50e4e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:46.400908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d585-bedd-47de-a621-077cd9e50e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:46.464501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-83d8d585-bedd-47de-a621-077cd9e50e4e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:46.465713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-83d8d585-bedd-47de-a621-077cd9e50e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:46.539484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:46.562362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 653/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:46.601673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac8070-63f9-4ed8-abe6-9e110b68c7e6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:46.603233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d2ac8070-63f9-4ed8-abe6-9e110b68c7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:46.705939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac8070-63f9-4ed8-abe6-9e110b68c7e6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:46.733946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:46.778122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:46.778759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:46.779038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:46.779309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:46.780916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:46.886510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:46.887939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc83c89-4316-4410-b8be-bb677121cc67 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:46.906136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 684/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:49.637574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f0f7-c8a2-431e-9c7d-2338cf64231f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:49.638131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f0f7-c8a2-431e-9c7d-2338cf64231f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:49.638267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f0f7-c8a2-431e-9c7d-2338cf64231f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:49.639551 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 654/1338] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:49.644808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85416e3-4391-4be7-9f63-4ec01711741e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:49.645204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85416e3-4391-4be7-9f63-4ec01711741e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:49.645445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85416e3-4391-4be7-9f63-4ec01711741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:49.709532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d85416e3-4391-4be7-9f63-4ec01711741e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:49.710770 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d85416e3-4391-4be7-9f63-4ec01711741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:49.719074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:49.804745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 685/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:49.840243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f0f7-c8a2-431e-9c7d-2338cf64231f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:49.841770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c366f0f7-c8a2-431e-9c7d-2338cf64231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:49.943118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f0f7-c8a2-431e-9c7d-2338cf64231f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:50.016816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:50.017457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:50.017734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:50.018032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:50.019669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:50.054904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:50.126273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:50.127727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07360c14-c812-4b56-9182-fe947cad440f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:50.145729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 655/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:54.468259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680312-d87a-43b3-b5c4-3d75fbfba543 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:54.468755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680312-d87a-43b3-b5c4-3d75fbfba543 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:54.468861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680312-d87a-43b3-b5c4-3d75fbfba543 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:54.470269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 686/1341] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:54.476992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8683-187f-46e4-892d-8f5a444138d3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:54.477460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8683-187f-46e4-892d-8f5a444138d3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:54.477733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8683-187f-46e4-892d-8f5a444138d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:54.558582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-632c8683-187f-46e4-892d-8f5a444138d3 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:54.559868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-632c8683-187f-46e4-892d-8f5a444138d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:54.664807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:54.678951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 656/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:54.717556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6680312-d87a-43b3-b5c4-3d75fbfba543 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:54.719725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c6680312-d87a-43b3-b5c4-3d75fbfba543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:54.815196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6680312-d87a-43b3-b5c4-3d75fbfba543 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:54.818705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3017385-c84c-45e5-a0ac-eb0b21d4be48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:54.819362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017385-c84c-45e5-a0ac-eb0b21d4be48 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:54.819650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017385-c84c-45e5-a0ac-eb0b21d4be48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:54.819934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017385-c84c-45e5-a0ac-eb0b21d4be48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:54.829708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3017385-c84c-45e5-a0ac-eb0b21d4be48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:54.831204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3017385-c84c-45e5-a0ac-eb0b21d4be48 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:54.840869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 687/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:57.808691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a560a-60f0-49ae-8486-f91285a2069c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:57.809242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a560a-60f0-49ae-8486-f91285a2069c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:57.809242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a560a-60f0-49ae-8486-f91285a2069c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:57.810723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 657/1344] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:57.816513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfceab3-fe8f-4e98-af2b-13babd05eb43 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:57.817008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfceab3-fe8f-4e98-af2b-13babd05eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:57.817098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfceab3-fe8f-4e98-af2b-13babd05eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:57.847961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4bfceab3-fe8f-4e98-af2b-13babd05eb43 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:57.849201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4bfceab3-fe8f-4e98-af2b-13babd05eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:57.879680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:57.931350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 688/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:57.969676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a560a-60f0-49ae-8486-f91285a2069c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:57.971399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2f1a560a-60f0-49ae-8486-f91285a2069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:57.984196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a560a-60f0-49ae-8486-f91285a2069c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:57.987674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b0cd3-f81d-4bf8-b80e-d73cc38d56b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:57.988300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0cd3-f81d-4bf8-b80e-d73cc38d56b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:57.988578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0cd3-f81d-4bf8-b80e-d73cc38d56b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:57.988850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0cd3-f81d-4bf8-b80e-d73cc38d56b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:57.997719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b0cd3-f81d-4bf8-b80e-d73cc38d56b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:57.999190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b0cd3-f81d-4bf8-b80e-d73cc38d56b7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:58.008657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 658/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:02.578628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584721e-957a-44d5-a655-f6b08c0473e4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:02.579134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584721e-957a-44d5-a655-f6b08c0473e4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:02.579381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584721e-957a-44d5-a655-f6b08c0473e4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:02.580686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 689/1347] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:02.586276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4780d-3a15-417b-81c3-547de879fc51 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:02.586719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4780d-3a15-417b-81c3-547de879fc51 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:02.586813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4780d-3a15-417b-81c3-547de879fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:02.605637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bec4780d-3a15-417b-81c3-547de879fc51 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:02.606857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bec4780d-3a15-417b-81c3-547de879fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:02.623593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 659/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:02.662344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584721e-957a-44d5-a655-f6b08c0473e4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:02.673166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584721e-957a-44d5-a655-f6b08c0473e4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:02.680083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889010f8-63b4-408e-8cc0-e90556e51292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:02.681883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889010f8-63b4-408e-8cc0-e90556e51292 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:02.682218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889010f8-63b4-408e-8cc0-e90556e51292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:02.682502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889010f8-63b4-408e-8cc0-e90556e51292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:02.693935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889010f8-63b4-408e-8cc0-e90556e51292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:02.695422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889010f8-63b4-408e-8cc0-e90556e51292 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:02.706394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 690/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:07.695761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a1f3-e73f-4348-9498-6bb47b9f87d8 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:07.696289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a1f3-e73f-4348-9498-6bb47b9f87d8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:07.696676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a1f3-e73f-4348-9498-6bb47b9f87d8 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:07.698760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 660/1350] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:20:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:07.707868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a3da3-8727-47dd-8130-3878361683fe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:07.708887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a3da3-8727-47dd-8130-3878361683fe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:07.709427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a3da3-8727-47dd-8130-3878361683fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:07.797774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ca5a3da3-8727-47dd-8130-3878361683fe None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:07.799083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca5a3da3-8727-47dd-8130-3878361683fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:07.896374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 691/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:20:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:12.363660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc932ee-b7bc-417f-9132-06880ca54a97 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:12.364328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc932ee-b7bc-417f-9132-06880ca54a97 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:12.364328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc932ee-b7bc-417f-9132-06880ca54a97 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:12.365638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 661/1352] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:12.371269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ff894-87a7-4f1d-9789-5b92e4284496 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:12.371764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ff894-87a7-4f1d-9789-5b92e4284496 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:12.372054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ff894-87a7-4f1d-9789-5b92e4284496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:12.391343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-176ff894-87a7-4f1d-9789-5b92e4284496 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:12.392536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-176ff894-87a7-4f1d-9789-5b92e4284496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:12.401448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 692/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:12.600263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=13 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:14.257286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc850fec-12a8-4db0-812d-6be22f7dff1c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:14.257923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc850fec-12a8-4db0-812d-6be22f7dff1c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:14.257923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc850fec-12a8-4db0-812d-6be22f7dff1c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:14.259235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 662/1354] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:14.264704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834193-1d2e-49ac-af41-1e83bdffcf05 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:14.265131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834193-1d2e-49ac-af41-1e83bdffcf05 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:14.265266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834193-1d2e-49ac-af41-1e83bdffcf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:14.283739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dd834193-1d2e-49ac-af41-1e83bdffcf05 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:14.284928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dd834193-1d2e-49ac-af41-1e83bdffcf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:14.293342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 693/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:17.780548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019ef7b-0435-438f-bb9f-df7d5dd606d0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:17.781057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019ef7b-0435-438f-bb9f-df7d5dd606d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:17.781057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019ef7b-0435-438f-bb9f-df7d5dd606d0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:17.782892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 663/1356] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:17.788236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3922b3-4cf3-4a44-8b35-81bdab4c38e5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:17.789336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3922b3-4cf3-4a44-8b35-81bdab4c38e5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:17.789830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3922b3-4cf3-4a44-8b35-81bdab4c38e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:17.811221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0d3922b3-4cf3-4a44-8b35-81bdab4c38e5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:17.812565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d3922b3-4cf3-4a44-8b35-81bdab4c38e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:17.820555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 694/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:17.880955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3607a-63a1-4ae5-bee5-764268233e84 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:17.881434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3607a-63a1-4ae5-bee5-764268233e84 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:17.881556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3607a-63a1-4ae5-bee5-764268233e84 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:17.883430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 664/1358] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jun 20 12:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:17.896830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d29cdc-d96b-470a-b255-492c5c519396 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:17.897360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d29cdc-d96b-470a-b255-492c5c519396 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:17.897797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d29cdc-d96b-470a-b255-492c5c519396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:17.946316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:17.954931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b3d29cdc-d96b-470a-b255-492c5c519396 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:17.956383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b3d29cdc-d96b-470a-b255-492c5c519396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:18.042625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 695/1359] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jun 20 12:20:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:18.051578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3607a-63a1-4ae5-bee5-764268233e84 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:18.067618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3607a-63a1-4ae5-bee5-764268233e84 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:18.074045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b10f45-e73a-4de8-b6ec-58f50f7cbd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:18.074954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b10f45-e73a-4de8-b6ec-58f50f7cbd13 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:18.075460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b10f45-e73a-4de8-b6ec-58f50f7cbd13 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:18.075973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b10f45-e73a-4de8-b6ec-58f50f7cbd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:18.085557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b10f45-e73a-4de8-b6ec-58f50f7cbd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:18.087518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b10f45-e73a-4de8-b6ec-58f50f7cbd13 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:18.116120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 665/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:20.367105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26a8f5-88c0-4f40-945b-298d90422325 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:20.367620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26a8f5-88c0-4f40-945b-298d90422325 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:20.367620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26a8f5-88c0-4f40-945b-298d90422325 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:20.369110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 696/1361] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:20.374168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35eac6-1c72-43c5-8f35-ea140b619809 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:20.374571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35eac6-1c72-43c5-8f35-ea140b619809 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:20.374731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35eac6-1c72-43c5-8f35-ea140b619809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:20.394649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8e35eac6-1c72-43c5-8f35-ea140b619809 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:20.395864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e35eac6-1c72-43c5-8f35-ea140b619809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:20.403899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 666/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:20.449443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26a8f5-88c0-4f40-945b-298d90422325 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:20.464841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26a8f5-88c0-4f40-945b-298d90422325 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:20.471545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55178b-b7e9-475d-a380-063d62a7e064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:20.472190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55178b-b7e9-475d-a380-063d62a7e064 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:20.472476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55178b-b7e9-475d-a380-063d62a7e064 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:20.472867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55178b-b7e9-475d-a380-063d62a7e064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:20.484556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55178b-b7e9-475d-a380-063d62a7e064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:20.486267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55178b-b7e9-475d-a380-063d62a7e064 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:20.496800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 697/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:23.051868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357c91-0065-4745-b44f-deb31b4633f1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:23.052399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357c91-0065-4745-b44f-deb31b4633f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:23.052606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357c91-0065-4745-b44f-deb31b4633f1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:23.054053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 667/1364] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:23.059344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75830-aa78-47d0-bcba-22dd0ef557f2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:23.059750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75830-aa78-47d0-bcba-22dd0ef557f2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:23.059909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75830-aa78-47d0-bcba-22dd0ef557f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:23.077621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b7a75830-aa78-47d0-bcba-22dd0ef557f2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:23.078850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b7a75830-aa78-47d0-bcba-22dd0ef557f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:23.086653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 698/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:23.135295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dbbdb-9556-42c4-b09a-19df8e7f809a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:23.135875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dbbdb-9556-42c4-b09a-19df8e7f809a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:23.136232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dbbdb-9556-42c4-b09a-19df8e7f809a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:23.137773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 668/1366] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jun 20 12:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:23.143374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2360b-f838-41e6-924b-441c0c6adf7e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:23.143669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2360b-f838-41e6-924b-441c0c6adf7e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:23.143956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2360b-f838-41e6-924b-441c0c6adf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:23.162871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c9b2360b-f838-41e6-924b-441c0c6adf7e None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:23.164089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9b2360b-f838-41e6-924b-441c0c6adf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:23.174585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 699/1367] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jun 20 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:23.182393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dbbdb-9556-42c4-b09a-19df8e7f809a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:23.196611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dbbdb-9556-42c4-b09a-19df8e7f809a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:23.207479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67dee7-8dc6-46aa-930e-cb7e1ef3bdf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:23.208133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dee7-8dc6-46aa-930e-cb7e1ef3bdf1 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:23.208418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dee7-8dc6-46aa-930e-cb7e1ef3bdf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:23.208697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dee7-8dc6-46aa-930e-cb7e1ef3bdf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:23.218456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67dee7-8dc6-46aa-930e-cb7e1ef3bdf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:23.220069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67dee7-8dc6-46aa-930e-cb7e1ef3bdf1 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:23.229972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 669/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:25.481132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594074b0-273f-444b-930b-bc0a1ab59d62 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:25.481707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594074b0-273f-444b-930b-bc0a1ab59d62 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:25.481707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594074b0-273f-444b-930b-bc0a1ab59d62 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:25.483670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 700/1369] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:25.489135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc948dfd-40b6-44b3-ba51-0ef2c868530c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:25.489896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc948dfd-40b6-44b3-ba51-0ef2c868530c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:25.490352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc948dfd-40b6-44b3-ba51-0ef2c868530c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:25.508894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fc948dfd-40b6-44b3-ba51-0ef2c868530c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:25.510417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fc948dfd-40b6-44b3-ba51-0ef2c868530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:25.519270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 670/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:25.564846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594074b0-273f-444b-930b-bc0a1ab59d62 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:25.580155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594074b0-273f-444b-930b-bc0a1ab59d62 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:25.585791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85affe15-1cc1-431a-a0f5-6b900b215e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:25.586475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85affe15-1cc1-431a-a0f5-6b900b215e45 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:25.586763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85affe15-1cc1-431a-a0f5-6b900b215e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:25.587044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85affe15-1cc1-431a-a0f5-6b900b215e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:25.595861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85affe15-1cc1-431a-a0f5-6b900b215e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:25.597466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85affe15-1cc1-431a-a0f5-6b900b215e45 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:25.608390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 701/1371] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:25.868915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf525-469e-4674-89fd-f9a59bce0887 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:25.869197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf525-469e-4674-89fd-f9a59bce0887 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:25.869714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf525-469e-4674-89fd-f9a59bce0887 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:25.871422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 671/1372] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:25.877800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f97220-d7b2-4f2c-b6f4-258b6842c7d9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:25.878365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f97220-d7b2-4f2c-b6f4-258b6842c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:25.878846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f97220-d7b2-4f2c-b6f4-258b6842c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:25.898433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d4f97220-d7b2-4f2c-b6f4-258b6842c7d9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:25.900003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d4f97220-d7b2-4f2c-b6f4-258b6842c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:25.912947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 702/1373] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:26.261801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3993-7da7-4491-be37-39c0345cc416 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:26.261801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3993-7da7-4491-be37-39c0345cc416 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:26.261801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3993-7da7-4491-be37-39c0345cc416 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:26.262463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 672/1374] 10.222.0.70 () {54 vars in 963 bytes} [Mon Jun 20 12:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:26.268174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd277d-2175-41d8-b372-391bd592f8fa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:26.269334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd277d-2175-41d8-b372-391bd592f8fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:26.269334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd277d-2175-41d8-b372-391bd592f8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:26.323246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c6bd277d-2175-41d8-b372-391bd592f8fa None None] MFA Rules not processed for user `f08d1a5b8e594901b986f1bde71e015a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:26.324457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c6bd277d-2175-41d8-b372-391bd592f8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:26.391974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 703/1375] 10.222.0.70 () {58 vars in 1060 bytes} [Mon Jun 20 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:26.398450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3993-7da7-4491-be37-39c0345cc416 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:26.410401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3993-7da7-4491-be37-39c0345cc416 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:26.413940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d085-66e4-4419-842a-a42560273efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:26.414611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d085-66e4-4419-842a-a42560273efe service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:26.415084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d085-66e4-4419-842a-a42560273efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:26.415355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d085-66e4-4419-842a-a42560273efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:26.425544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2d085-66e4-4419-842a-a42560273efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:26.427236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2d085-66e4-4419-842a-a42560273efe service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:26.437415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 673/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:27.865314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1adcaf-274f-4a72-bb9c-e06be6171e05 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:27.865761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1adcaf-274f-4a72-bb9c-e06be6171e05 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:27.865895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1adcaf-274f-4a72-bb9c-e06be6171e05 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:27.867416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 704/1377] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:27.872556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988bb57-9fe3-4ad1-963d-9033927ad479 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:27.872970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988bb57-9fe3-4ad1-963d-9033927ad479 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:27.873136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988bb57-9fe3-4ad1-963d-9033927ad479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:27.891479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8988bb57-9fe3-4ad1-963d-9033927ad479 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:27.892679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8988bb57-9fe3-4ad1-963d-9033927ad479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:27.900532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 674/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:27.944325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1adcaf-274f-4a72-bb9c-e06be6171e05 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:27.959666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1adcaf-274f-4a72-bb9c-e06be6171e05 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:27.965161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241800a9-b2ff-4627-bb64-f3c6cf834aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:27.965802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241800a9-b2ff-4627-bb64-f3c6cf834aef service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:27.976289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241800a9-b2ff-4627-bb64-f3c6cf834aef service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:27.976289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241800a9-b2ff-4627-bb64-f3c6cf834aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:27.976289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241800a9-b2ff-4627-bb64-f3c6cf834aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:27.976781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241800a9-b2ff-4627-bb64-f3c6cf834aef service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:27.980700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:27.986758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 705/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:30.199280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23691c-e4f1-4ff1-95a5-165d116842b3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:30.199812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23691c-e4f1-4ff1-95a5-165d116842b3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:30.199933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23691c-e4f1-4ff1-95a5-165d116842b3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:30.201364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 675/1380] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:30.207043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e3f32-e26c-40a6-85fd-634d57dfd30e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:30.209178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e3f32-e26c-40a6-85fd-634d57dfd30e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:30.209178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e3f32-e26c-40a6-85fd-634d57dfd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:30.227216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bf2e3f32-e26c-40a6-85fd-634d57dfd30e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:30.228407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bf2e3f32-e26c-40a6-85fd-634d57dfd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:30.237191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 706/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:30.281676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23691c-e4f1-4ff1-95a5-165d116842b3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:30.297076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23691c-e4f1-4ff1-95a5-165d116842b3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:30.302944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08acc6c-3b59-4f5d-a755-ad32c1ce66a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:30.303582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acc6c-3b59-4f5d-a755-ad32c1ce66a5 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:30.303870 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acc6c-3b59-4f5d-a755-ad32c1ce66a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:30.304149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acc6c-3b59-4f5d-a755-ad32c1ce66a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:30.313605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08acc6c-3b59-4f5d-a755-ad32c1ce66a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:30.315227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08acc6c-3b59-4f5d-a755-ad32c1ce66a5 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:30.325224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 676/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:32.542934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e743ea-30e2-4bab-b3af-79e24c200867 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:32.543515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e743ea-30e2-4bab-b3af-79e24c200867 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:32.543515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e743ea-30e2-4bab-b3af-79e24c200867 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:32.544898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 707/1383] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:32.550312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fe2e3-a48b-4182-9720-bbb81644048f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:32.550715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fe2e3-a48b-4182-9720-bbb81644048f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:32.550873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fe2e3-a48b-4182-9720-bbb81644048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:32.568294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-181fe2e3-a48b-4182-9720-bbb81644048f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:32.569492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-181fe2e3-a48b-4182-9720-bbb81644048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:32.577881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 677/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:32.618825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e743ea-30e2-4bab-b3af-79e24c200867 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:32.635293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e743ea-30e2-4bab-b3af-79e24c200867 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:32.640779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d901b5-33bc-4214-b6e1-400a1ca7291f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:32.641460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d901b5-33bc-4214-b6e1-400a1ca7291f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:32.641748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d901b5-33bc-4214-b6e1-400a1ca7291f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:32.642089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d901b5-33bc-4214-b6e1-400a1ca7291f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:32.651427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d901b5-33bc-4214-b6e1-400a1ca7291f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:32.653713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d901b5-33bc-4214-b6e1-400a1ca7291f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:32.663999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 708/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:34.874826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5c40-0b26-48f4-a1bc-558ca65f8cc0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:34.875388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5c40-0b26-48f4-a1bc-558ca65f8cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:34.875388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5c40-0b26-48f4-a1bc-558ca65f8cc0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:34.876807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 678/1386] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:34.882379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551785-8c0e-487f-8c17-0decf2568f23 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:34.882793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551785-8c0e-487f-8c17-0decf2568f23 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:34.882964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551785-8c0e-487f-8c17-0decf2568f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:34.901272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5a551785-8c0e-487f-8c17-0decf2568f23 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:34.902811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5a551785-8c0e-487f-8c17-0decf2568f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:34.911525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 709/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:34.958025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5c40-0b26-48f4-a1bc-558ca65f8cc0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:34.977443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5c40-0b26-48f4-a1bc-558ca65f8cc0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:34.984977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac387-fe74-4981-b7e9-2c579a1b2407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:34.985765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac387-fe74-4981-b7e9-2c579a1b2407 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:34.986146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac387-fe74-4981-b7e9-2c579a1b2407 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:34.986559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac387-fe74-4981-b7e9-2c579a1b2407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:34.997473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac387-fe74-4981-b7e9-2c579a1b2407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:34.999570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac387-fe74-4981-b7e9-2c579a1b2407 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:35.011718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 679/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:20:37.296521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00414-f347-44a7-b29b-acf90ca6416b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:37.297246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00414-f347-44a7-b29b-acf90ca6416b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:37.297246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00414-f347-44a7-b29b-acf90ca6416b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:37.298573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 710/1389] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:20:37.304559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae2db-50e9-4b8f-9d95-2e8bad0fbd87 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:37.305113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae2db-50e9-4b8f-9d95-2e8bad0fbd87 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:37.305205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae2db-50e9-4b8f-9d95-2e8bad0fbd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:37.324268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dc3ae2db-50e9-4b8f-9d95-2e8bad0fbd87 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:37.328137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dc3ae2db-50e9-4b8f-9d95-2e8bad0fbd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:37.334534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 680/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:37.379875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00414-f347-44a7-b29b-acf90ca6416b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:37.398591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00414-f347-44a7-b29b-acf90ca6416b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:37.405845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b150c-e327-4841-ab65-9ac61ee77f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:37.406688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b150c-e327-4841-ab65-9ac61ee77f4f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:37.407047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b150c-e327-4841-ab65-9ac61ee77f4f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:37.407398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b150c-e327-4841-ab65-9ac61ee77f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:37.418205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b150c-e327-4841-ab65-9ac61ee77f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:37.420265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b150c-e327-4841-ab65-9ac61ee77f4f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:37.432537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 711/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:39.672985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90be134-5ea9-40b2-87f0-73c3ccb40d69 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:39.673665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90be134-5ea9-40b2-87f0-73c3ccb40d69 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:39.673665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90be134-5ea9-40b2-87f0-73c3ccb40d69 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:39.675247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 681/1392] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:39.680666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c737a-223e-4888-b506-892689a802ff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:39.681086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c737a-223e-4888-b506-892689a802ff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:39.681230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c737a-223e-4888-b506-892689a802ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:39.698774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5b0c737a-223e-4888-b506-892689a802ff None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:39.699977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5b0c737a-223e-4888-b506-892689a802ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:39.707929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 712/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:39.755925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90be134-5ea9-40b2-87f0-73c3ccb40d69 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:39.775915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90be134-5ea9-40b2-87f0-73c3ccb40d69 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:39.786044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc4e3a-1478-422e-a647-e8f1069fc79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:39.786662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc4e3a-1478-422e-a647-e8f1069fc79b service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:39.787181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc4e3a-1478-422e-a647-e8f1069fc79b service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:39.787709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc4e3a-1478-422e-a647-e8f1069fc79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:39.799048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc4e3a-1478-422e-a647-e8f1069fc79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:39.800997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc4e3a-1478-422e-a647-e8f1069fc79b service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:39.811272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 682/1394] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:41.907927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf3bd-34e1-485a-90f4-7d040270395b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:41.908465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf3bd-34e1-485a-90f4-7d040270395b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:41.908585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf3bd-34e1-485a-90f4-7d040270395b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:41.910043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 713/1395] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:41.915410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1794d-a6e8-497b-bd63-6fa8333faa0a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:41.915820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1794d-a6e8-497b-bd63-6fa8333faa0a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:41.915972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1794d-a6e8-497b-bd63-6fa8333faa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:41.933709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-81b1794d-a6e8-497b-bd63-6fa8333faa0a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:41.935432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81b1794d-a6e8-497b-bd63-6fa8333faa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:41.943487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 683/1396] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:41.961750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e02cac-8441-468c-ac20-ff23d5970aa3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:41.962074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e02cac-8441-468c-ac20-ff23d5970aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:41.962361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e02cac-8441-468c-ac20-ff23d5970aa3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:41.963723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 714/1397] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:41.968842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01be6f-d113-46a4-89ca-a43e2679ee1b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:41.969132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01be6f-d113-46a4-89ca-a43e2679ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:41.969413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01be6f-d113-46a4-89ca-a43e2679ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:41.988045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bf01be6f-d113-46a4-89ca-a43e2679ee1b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:41.989239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf01be6f-d113-46a4-89ca-a43e2679ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:41.997870 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 684/1398] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:42.000473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79d4b3-a9e0-4433-ae27-79370671a42b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:42.000766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79d4b3-a9e0-4433-ae27-79370671a42b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:42.001048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79d4b3-a9e0-4433-ae27-79370671a42b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:42.002442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 715/1399] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jun 20 12:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:42.007149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec09f-7c70-4f37-ada7-c22f53dfb0a0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:42.007432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec09f-7c70-4f37-ada7-c22f53dfb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:42.007710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec09f-7c70-4f37-ada7-c22f53dfb0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:42.041282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79d4b3-a9e0-4433-ae27-79370671a42b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:42.056210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b5fec09f-7c70-4f37-ada7-c22f53dfb0a0 None None] MFA Rules not processed for user `f2124f6539264fa3a4b0ec190e23b2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:42.056956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79d4b3-a9e0-4433-ae27-79370671a42b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:42.057396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b5fec09f-7c70-4f37-ada7-c22f53dfb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:42.063411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:42.064060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:42.064348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:42.064621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:42.073857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:42.075510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:42.085069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 716/1400] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:20:42.117598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 685/1401] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jun 20 12:20:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:20:42.125877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:42.134895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38c0f-1b73-4f4c-ace2-5ca64f795a94 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:42.138476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1180fd5-02e2-44e7-afb5-854cb454dde9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:42.139103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1180fd5-02e2-44e7-afb5-854cb454dde9 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:42.139431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1180fd5-02e2-44e7-afb5-854cb454dde9 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:42.139710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1180fd5-02e2-44e7-afb5-854cb454dde9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:42.148523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1180fd5-02e2-44e7-afb5-854cb454dde9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:42.149937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1180fd5-02e2-44e7-afb5-854cb454dde9 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:42.159379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 717/1402] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:43.174224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb22b7-040e-4026-807b-1b1ed2d7c85d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:43.174716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb22b7-040e-4026-807b-1b1ed2d7c85d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:43.174928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb22b7-040e-4026-807b-1b1ed2d7c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:43.180640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:43.227112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b9cb22b7-040e-4026-807b-1b1ed2d7c85d None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:43.228343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9cb22b7-040e-4026-807b-1b1ed2d7c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:43.294754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 686/1403] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:43.343764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08807d42-7ac7-43e3-a7ee-6eb9e006a1b0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:43.344645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08807d42-7ac7-43e3-a7ee-6eb9e006a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:43.344896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08807d42-7ac7-43e3-a7ee-6eb9e006a1b0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:43.346776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 718/1404] 10.222.0.70 () {54 vars in 942 bytes} [Mon Jun 20 12:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:43.354381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b10df-3e9f-4955-8414-7ee50aea9934 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:43.354786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b10df-3e9f-4955-8414-7ee50aea9934 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:43.355072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b10df-3e9f-4955-8414-7ee50aea9934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:43.408757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3e3b10df-3e9f-4955-8414-7ee50aea9934 None None] MFA Rules not processed for user `1e132b21d8bb426391e00c48f22b9922`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:43.410009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3e3b10df-3e9f-4955-8414-7ee50aea9934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:43.492840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 687/1405] 10.222.0.70 () {58 vars in 1039 bytes} [Mon Jun 20 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:43.502683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08807d42-7ac7-43e3-a7ee-6eb9e006a1b0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:43.516620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08807d42-7ac7-43e3-a7ee-6eb9e006a1b0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:43.521662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cdaf6-4c06-4562-a185-58fd852c6fab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:43.522362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cdaf6-4c06-4562-a185-58fd852c6fab service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:43.522653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cdaf6-4c06-4562-a185-58fd852c6fab service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:43.522930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cdaf6-4c06-4562-a185-58fd852c6fab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:43.531212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cdaf6-4c06-4562-a185-58fd852c6fab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:43.534710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cdaf6-4c06-4562-a185-58fd852c6fab service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:43.541539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 719/1406] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:20:44.291070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345daffe-36ad-4fd2-9662-5983ba725c3d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:44.291619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345daffe-36ad-4fd2-9662-5983ba725c3d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:44.291726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345daffe-36ad-4fd2-9662-5983ba725c3d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:44.293205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 688/1407] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:44.298599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21613-47e3-44a1-90c3-c68e95e0d791 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:44.299068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21613-47e3-44a1-90c3-c68e95e0d791 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:44.299351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21613-47e3-44a1-90c3-c68e95e0d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:44.319008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0cf21613-47e3-44a1-90c3-c68e95e0d791 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:44.320365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0cf21613-47e3-44a1-90c3-c68e95e0d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:44.329508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 720/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:44.374438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345daffe-36ad-4fd2-9662-5983ba725c3d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:44.390243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345daffe-36ad-4fd2-9662-5983ba725c3d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:44.396168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df966ac-9d90-4890-84c3-08d5b77a76ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:44.396910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df966ac-9d90-4890-84c3-08d5b77a76ed service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:44.397195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df966ac-9d90-4890-84c3-08d5b77a76ed service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:44.397480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df966ac-9d90-4890-84c3-08d5b77a76ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:44.407351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df966ac-9d90-4890-84c3-08d5b77a76ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:44.409096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df966ac-9d90-4890-84c3-08d5b77a76ed service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:44.419642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 689/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:54.313707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=43 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:54.414515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:06.680076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4136-ab82-4916-b2df-ace18b934668 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:06.680625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4136-ab82-4916-b2df-ace18b934668 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:06.680625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4136-ab82-4916-b2df-ace18b934668 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:06.682019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 721/1410] 10.222.0.70 () {54 vars in 918 bytes} [Mon Jun 20 12:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:06.687144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2c5e-f154-4a65-8f4a-e78c8a5c0785 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:06.687571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2c5e-f154-4a65-8f4a-e78c8a5c0785 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:06.687693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2c5e-f154-4a65-8f4a-e78c8a5c0785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:06.705844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fd6a2c5e-f154-4a65-8f4a-e78c8a5c0785 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:06.707090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fd6a2c5e-f154-4a65-8f4a-e78c8a5c0785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:06.715455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 690/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jun 20 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:06.729973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7875b-0487-418d-a0ee-b1020d337eb0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:06.730312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7875b-0487-418d-a0ee-b1020d337eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:06.730600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7875b-0487-418d-a0ee-b1020d337eb0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:06.731927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 722/1412] 10.222.0.70 () {54 vars in 918 bytes} [Mon Jun 20 12:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:06.736344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa60222-d44d-40f9-b9a7-f7e16be6d822 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:06.736632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa60222-d44d-40f9-b9a7-f7e16be6d822 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:06.736912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa60222-d44d-40f9-b9a7-f7e16be6d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:06.754412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eaa60222-d44d-40f9-b9a7-f7e16be6d822 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:06.755615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eaa60222-d44d-40f9-b9a7-f7e16be6d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:06.764753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 691/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jun 20 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:09.264983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd2bc4-9023-43cd-9354-b7ee03fc9327 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:09.265549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd2bc4-9023-43cd-9354-b7ee03fc9327 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:09.265549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd2bc4-9023-43cd-9354-b7ee03fc9327 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:09.266935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:09.271976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6fa7-ddd4-4bb9-b5af-2ce68846b616 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:09.272389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6fa7-ddd4-4bb9-b5af-2ce68846b616 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:09.272527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6fa7-ddd4-4bb9-b5af-2ce68846b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:09.290535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-932e6fa7-ddd4-4bb9-b5af-2ce68846b616 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:09.291733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-932e6fa7-ddd4-4bb9-b5af-2ce68846b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:09.300204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:09.342538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd2bc4-9023-43cd-9354-b7ee03fc9327 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:09.357103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd2bc4-9023-43cd-9354-b7ee03fc9327 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:09.362958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5e97d-a924-478f-9b11-cd98b6480e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:09.363582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5e97d-a924-478f-9b11-cd98b6480e7e service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:09.363864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5e97d-a924-478f-9b11-cd98b6480e7e service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:09.364139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5e97d-a924-478f-9b11-cd98b6480e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:09.372215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5e97d-a924-478f-9b11-cd98b6480e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:09.373792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5e97d-a924-478f-9b11-cd98b6480e7e service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:09.383043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 724/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:10.279478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c069ff-9f8c-4140-985a-ead623ec74b0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:10.280045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c069ff-9f8c-4140-985a-ead623ec74b0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:10.280045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c069ff-9f8c-4140-985a-ead623ec74b0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:10.281973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:10.286932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5229-207c-4aa5-8862-d6f71ff0fe34 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:10.287337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5229-207c-4aa5-8862-d6f71ff0fe34 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:10.287496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5229-207c-4aa5-8862-d6f71ff0fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:10.306050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-27df5229-207c-4aa5-8862-d6f71ff0fe34 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:10.307226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-27df5229-207c-4aa5-8862-d6f71ff0fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:10.314974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:10.466296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c069ff-9f8c-4140-985a-ead623ec74b0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:10.481370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c069ff-9f8c-4140-985a-ead623ec74b0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:10.486891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d83edd-9a53-4ddc-9a4f-6ec38b90294a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:10.487551 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83edd-9a53-4ddc-9a4f-6ec38b90294a service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:10.487855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83edd-9a53-4ddc-9a4f-6ec38b90294a service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:10.488142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83edd-9a53-4ddc-9a4f-6ec38b90294a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:10.496516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d83edd-9a53-4ddc-9a4f-6ec38b90294a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:10.498178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d83edd-9a53-4ddc-9a4f-6ec38b90294a service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:10.507636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 694/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:11.408226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c3d0-681f-41b3-ae48-6d4df845fa88 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:11.408767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c3d0-681f-41b3-ae48-6d4df845fa88 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:11.408767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c3d0-681f-41b3-ae48-6d4df845fa88 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:11.410213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:11.415021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93fe29-3f0b-4e4f-bf23-f905f1014460 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:11.415460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93fe29-3f0b-4e4f-bf23-f905f1014460 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:11.415582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93fe29-3f0b-4e4f-bf23-f905f1014460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:11.434242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9e93fe29-3f0b-4e4f-bf23-f905f1014460 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:11.435422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9e93fe29-3f0b-4e4f-bf23-f905f1014460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:11.443206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:11.594172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c3d0-681f-41b3-ae48-6d4df845fa88 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:11.608231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c3d0-681f-41b3-ae48-6d4df845fa88 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:11.613713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bbb83-9be1-4b0b-b896-7667ef2c60ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:11.614375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbb83-9be1-4b0b-b896-7667ef2c60ee service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:11.614662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbb83-9be1-4b0b-b896-7667ef2c60ee service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:11.614943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bbb83-9be1-4b0b-b896-7667ef2c60ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:11.622995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bbb83-9be1-4b0b-b896-7667ef2c60ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:11.624611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bbb83-9be1-4b0b-b896-7667ef2c60ee service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:11.634527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 727/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:12.489478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f6d6-2c76-4625-a4d1-c2471c8ee218 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:12.490092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f6d6-2c76-4625-a4d1-c2471c8ee218 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:12.490092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6f6d6-2c76-4625-a4d1-c2471c8ee218 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:12.491422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:12.496356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24556190-f959-4f94-86db-0eb077233ede None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:12.496740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24556190-f959-4f94-86db-0eb077233ede None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:12.496921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24556190-f959-4f94-86db-0eb077233ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:12.514530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-24556190-f959-4f94-86db-0eb077233ede None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:12.515734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24556190-f959-4f94-86db-0eb077233ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:12.523721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:12.676988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f6d6-2c76-4625-a4d1-c2471c8ee218 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:12.691340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6f6d6-2c76-4625-a4d1-c2471c8ee218 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:12.696762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d6cc5-15bd-4ce6-bbab-9b4f345f0d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:12.697390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d6cc5-15bd-4ce6-bbab-9b4f345f0d2e service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:12.697675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d6cc5-15bd-4ce6-bbab-9b4f345f0d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:12.697956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d6cc5-15bd-4ce6-bbab-9b4f345f0d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:12.706555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d6cc5-15bd-4ce6-bbab-9b4f345f0d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:12.708151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d6cc5-15bd-4ce6-bbab-9b4f345f0d2e service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:12.717471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 697/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:13.568806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298de0-c070-495b-909e-3215b9e45f3c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:13.569395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298de0-c070-495b-909e-3215b9e45f3c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:13.569395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298de0-c070-495b-909e-3215b9e45f3c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:13.570772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:13.575707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf361a-4535-4d3b-ab7b-b9553b886859 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:13.576091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf361a-4535-4d3b-ab7b-b9553b886859 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:13.576261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf361a-4535-4d3b-ab7b-b9553b886859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:13.594419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6caf361a-4535-4d3b-ab7b-b9553b886859 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:13.596719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6caf361a-4535-4d3b-ab7b-b9553b886859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:13.603497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:13.754520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298de0-c070-495b-909e-3215b9e45f3c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:13.768998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298de0-c070-495b-909e-3215b9e45f3c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:13.774410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49b61-6756-4b75-aa9c-a11611302d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:13.775054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49b61-6756-4b75-aa9c-a11611302d1e service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:13.775339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49b61-6756-4b75-aa9c-a11611302d1e service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:13.775617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49b61-6756-4b75-aa9c-a11611302d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:13.785671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49b61-6756-4b75-aa9c-a11611302d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:13.787376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49b61-6756-4b75-aa9c-a11611302d1e service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:13.796813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 730/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:14.645173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191bfb-7206-451d-a345-3b544a47aca1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:14.645738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191bfb-7206-451d-a345-3b544a47aca1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:14.645738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191bfb-7206-451d-a345-3b544a47aca1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:14.647156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:14.652103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61c5e-b90d-43dc-807b-068193b9b35e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:14.652539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61c5e-b90d-43dc-807b-068193b9b35e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:14.652660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61c5e-b90d-43dc-807b-068193b9b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:14.670564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-63d61c5e-b90d-43dc-807b-068193b9b35e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:14.671743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63d61c5e-b90d-43dc-807b-068193b9b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:14.680211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:14.830190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191bfb-7206-451d-a345-3b544a47aca1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:14.844310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191bfb-7206-451d-a345-3b544a47aca1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:14.850447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8927e2-4e48-4c51-acfa-d8fead3da379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:14.851077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8927e2-4e48-4c51-acfa-d8fead3da379 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:14.851360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8927e2-4e48-4c51-acfa-d8fead3da379 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:14.851639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8927e2-4e48-4c51-acfa-d8fead3da379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:14.859655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8927e2-4e48-4c51-acfa-d8fead3da379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:14.861840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8927e2-4e48-4c51-acfa-d8fead3da379 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:14.871163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 700/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:15.713690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5b9c-4428-4f9c-b654-e1e5f4cccca3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:15.714262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5b9c-4428-4f9c-b654-e1e5f4cccca3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:15.714262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5b9c-4428-4f9c-b654-e1e5f4cccca3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:15.715633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:15.720557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c34576-d393-426e-9f5c-7fbad57f2c6c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:15.720989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c34576-d393-426e-9f5c-7fbad57f2c6c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:15.721120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c34576-d393-426e-9f5c-7fbad57f2c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:15.739341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-67c34576-d393-426e-9f5c-7fbad57f2c6c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:15.740592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-67c34576-d393-426e-9f5c-7fbad57f2c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:15.748481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:15.897647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5b9c-4428-4f9c-b654-e1e5f4cccca3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:15.912219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5b9c-4428-4f9c-b654-e1e5f4cccca3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:15.917523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a14682-a520-4ad8-ad59-540294827bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:15.918192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a14682-a520-4ad8-ad59-540294827bac service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:15.918474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a14682-a520-4ad8-ad59-540294827bac service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:15.918751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a14682-a520-4ad8-ad59-540294827bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:15.927414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a14682-a520-4ad8-ad59-540294827bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:15.928978 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a14682-a520-4ad8-ad59-540294827bac service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:15.938222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 733/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:16.781307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b536-7206-4327-8d71-113dd6bb1243 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:16.781845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b536-7206-4327-8d71-113dd6bb1243 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:16.781845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b536-7206-4327-8d71-113dd6bb1243 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:16.783790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:16.788623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdfa65-1044-4f9c-b3b8-e7efbd3bc468 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:16.789056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdfa65-1044-4f9c-b3b8-e7efbd3bc468 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:16.789180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdfa65-1044-4f9c-b3b8-e7efbd3bc468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:16.807958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1afdfa65-1044-4f9c-b3b8-e7efbd3bc468 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:16.809149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1afdfa65-1044-4f9c-b3b8-e7efbd3bc468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:16.816871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:16.969691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b536-7206-4327-8d71-113dd6bb1243 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:16.984266 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b536-7206-4327-8d71-113dd6bb1243 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:16.990198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486d11-fb6f-411c-8ab8-44a8f151f757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:16.990825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486d11-fb6f-411c-8ab8-44a8f151f757 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:16.991107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486d11-fb6f-411c-8ab8-44a8f151f757 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:16.991381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486d11-fb6f-411c-8ab8-44a8f151f757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:16.999365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486d11-fb6f-411c-8ab8-44a8f151f757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:17.000944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486d11-fb6f-411c-8ab8-44a8f151f757 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:17.010256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 703/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:17.858363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587312-7ed5-45f0-af0d-b0a41c412a89 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:17.858928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587312-7ed5-45f0-af0d-b0a41c412a89 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:17.858928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587312-7ed5-45f0-af0d-b0a41c412a89 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:17.860291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:17.865794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc71b1-f34f-4214-b0cd-7874659b081b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:17.866227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc71b1-f34f-4214-b0cd-7874659b081b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:17.866371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc71b1-f34f-4214-b0cd-7874659b081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:17.884043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-68bc71b1-f34f-4214-b0cd-7874659b081b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:17.885292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68bc71b1-f34f-4214-b0cd-7874659b081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:17.893723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:18.046264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7587312-7ed5-45f0-af0d-b0a41c412a89 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:18.061020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7587312-7ed5-45f0-af0d-b0a41c412a89 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:18.066534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03688-fc2b-4492-b172-33a4786a5b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:18.067171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03688-fc2b-4492-b172-33a4786a5b02 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:18.067456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03688-fc2b-4492-b172-33a4786a5b02 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:18.067735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03688-fc2b-4492-b172-33a4786a5b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:18.076042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03688-fc2b-4492-b172-33a4786a5b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:18.077622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03688-fc2b-4492-b172-33a4786a5b02 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:18.087583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 736/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:20.021422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb373a49-1cde-4de6-b7ca-7a05e2c60656 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:20.021953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb373a49-1cde-4de6-b7ca-7a05e2c60656 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:20.021953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb373a49-1cde-4de6-b7ca-7a05e2c60656 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:20.023319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:20.028544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fe917-d26d-4a78-ad61-b4ee5212318b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:20.028966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fe917-d26d-4a78-ad61-b4ee5212318b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:20.029120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fe917-d26d-4a78-ad61-b4ee5212318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:20.046662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8f7fe917-d26d-4a78-ad61-b4ee5212318b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:20.047893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8f7fe917-d26d-4a78-ad61-b4ee5212318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:20.056065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:20.095114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb373a49-1cde-4de6-b7ca-7a05e2c60656 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:20.106051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb373a49-1cde-4de6-b7ca-7a05e2c60656 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:20.109850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad914-add2-449b-937f-22def9de45d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:20.110532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad914-add2-449b-937f-22def9de45d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:20.111314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad914-add2-449b-937f-22def9de45d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:20.111593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad914-add2-449b-937f-22def9de45d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:20.120835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dad914-add2-449b-937f-22def9de45d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:20.122333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dad914-add2-449b-937f-22def9de45d4 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:20.132223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 706/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:21:22.324377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa032b-021d-47dc-9d92-a9c1aeda49f4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:22.324966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa032b-021d-47dc-9d92-a9c1aeda49f4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:22.324966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa032b-021d-47dc-9d92-a9c1aeda49f4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:22.326352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:22.332174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e2e4-78d7-4557-9306-9357a769ea49 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:22.332600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e2e4-78d7-4557-9306-9357a769ea49 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:22.332722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e2e4-78d7-4557-9306-9357a769ea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:22.350081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1214e2e4-78d7-4557-9306-9357a769ea49 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:22.351269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1214e2e4-78d7-4557-9306-9357a769ea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:22.359031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:22.397888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa032b-021d-47dc-9d92-a9c1aeda49f4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:22.408453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa032b-021d-47dc-9d92-a9c1aeda49f4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:22.411971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fc61a-cc23-4804-b0ef-d962b328b09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:22.412605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc61a-cc23-4804-b0ef-d962b328b09f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:22.412894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc61a-cc23-4804-b0ef-d962b328b09f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:22.413177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc61a-cc23-4804-b0ef-d962b328b09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:22.422026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fc61a-cc23-4804-b0ef-d962b328b09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:22.424034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fc61a-cc23-4804-b0ef-d962b328b09f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:22.433649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 739/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:24.871661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81bd70-f48a-48be-bb2f-34473b392511 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:24.872247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81bd70-f48a-48be-bb2f-34473b392511 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:24.872247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81bd70-f48a-48be-bb2f-34473b392511 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:24.873629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:24.878814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef712-6c83-417d-be68-4c28c0e4f698 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:24.879210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef712-6c83-417d-be68-4c28c0e4f698 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:24.879380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef712-6c83-417d-be68-4c28c0e4f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:24.897127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-597ef712-6c83-417d-be68-4c28c0e4f698 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:24.898341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-597ef712-6c83-417d-be68-4c28c0e4f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:24.906067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:24.944096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81bd70-f48a-48be-bb2f-34473b392511 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:24.955133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81bd70-f48a-48be-bb2f-34473b392511 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:24.958609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078d5b1-6623-4fba-8abf-ad818190bf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:24.959254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078d5b1-6623-4fba-8abf-ad818190bf38 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:24.959532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078d5b1-6623-4fba-8abf-ad818190bf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:24.959804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078d5b1-6623-4fba-8abf-ad818190bf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:24.968526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078d5b1-6623-4fba-8abf-ad818190bf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:24.969948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078d5b1-6623-4fba-8abf-ad818190bf38 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:24.979684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 709/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:21:27.122556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba618-69c0-41a6-bf00-9d8b48411fee None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:27.123094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba618-69c0-41a6-bf00-9d8b48411fee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:27.123094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba618-69c0-41a6-bf00-9d8b48411fee None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:27.124460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:27.129606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ac57e-e961-498f-bf5b-9205ba444edc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:27.130090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ac57e-e961-498f-bf5b-9205ba444edc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:27.130234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ac57e-e961-498f-bf5b-9205ba444edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:27.148443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0b4ac57e-e961-498f-bf5b-9205ba444edc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:27.149643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0b4ac57e-e961-498f-bf5b-9205ba444edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:27.158070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:27.196436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba618-69c0-41a6-bf00-9d8b48411fee None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:27.207529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba618-69c0-41a6-bf00-9d8b48411fee None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:27.211027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23184a49-9665-40bd-b4c6-265018583b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:27.211660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23184a49-9665-40bd-b4c6-265018583b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:27.211944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23184a49-9665-40bd-b4c6-265018583b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:27.212219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23184a49-9665-40bd-b4c6-265018583b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:27.221667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23184a49-9665-40bd-b4c6-265018583b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:27.223126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23184a49-9665-40bd-b4c6-265018583b05 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:27.232488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 742/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:29.315136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7458-7bd1-4811-9a2e-5cf8cb80bc1d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:29.315706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7458-7bd1-4811-9a2e-5cf8cb80bc1d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:29.315706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7458-7bd1-4811-9a2e-5cf8cb80bc1d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:29.317117 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:29.322275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5da0bf-8286-4eaa-ac14-3da169717d6a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:29.322685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5da0bf-8286-4eaa-ac14-3da169717d6a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:29.322842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5da0bf-8286-4eaa-ac14-3da169717d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:29.340477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a5da0bf-8286-4eaa-ac14-3da169717d6a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:29.341678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a5da0bf-8286-4eaa-ac14-3da169717d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:29.349394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:29.388706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7458-7bd1-4811-9a2e-5cf8cb80bc1d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:29.400088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7458-7bd1-4811-9a2e-5cf8cb80bc1d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:29.403703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72c889-04e4-40c4-8d33-a7f779873882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:29.404331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72c889-04e4-40c4-8d33-a7f779873882 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:29.404616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72c889-04e4-40c4-8d33-a7f779873882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:29.404896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72c889-04e4-40c4-8d33-a7f779873882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:29.413806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72c889-04e4-40c4-8d33-a7f779873882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:29.415293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72c889-04e4-40c4-8d33-a7f779873882 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:29.425431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 712/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:31.516637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1923e3-583b-4edf-b520-4504194f05a9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:31.517706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1923e3-583b-4edf-b520-4504194f05a9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:31.517706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1923e3-583b-4edf-b520-4504194f05a9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:31.519165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:31.524473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269dd0-402b-4b33-ada7-3118955982db None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:31.524895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269dd0-402b-4b33-ada7-3118955982db None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:31.525025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269dd0-402b-4b33-ada7-3118955982db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:31.542809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-86269dd0-402b-4b33-ada7-3118955982db None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:31.543995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-86269dd0-402b-4b33-ada7-3118955982db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:31.552011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:31.589214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1923e3-583b-4edf-b520-4504194f05a9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:31.600597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1923e3-583b-4edf-b520-4504194f05a9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:31.604085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b12a-964f-40b4-afb6-d12b728e7730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:31.604725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b12a-964f-40b4-afb6-d12b728e7730 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:31.605010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b12a-964f-40b4-afb6-d12b728e7730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:31.605288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b12a-964f-40b4-afb6-d12b728e7730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:31.614299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b12a-964f-40b4-afb6-d12b728e7730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:31.615810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b12a-964f-40b4-afb6-d12b728e7730 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:31.625269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 745/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:33.715294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1bdee-f1f9-4926-a5f2-4afa67c8601b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:33.715849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1bdee-f1f9-4926-a5f2-4afa67c8601b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:33.715849 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1bdee-f1f9-4926-a5f2-4afa67c8601b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:33.717236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:33.722512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a2104-2610-4fcd-aaf0-6092fa1dcd7a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:33.722950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a2104-2610-4fcd-aaf0-6092fa1dcd7a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:33.723058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a2104-2610-4fcd-aaf0-6092fa1dcd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:33.741535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-324a2104-2610-4fcd-aaf0-6092fa1dcd7a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:33.742771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-324a2104-2610-4fcd-aaf0-6092fa1dcd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:33.750515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:33.787410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1bdee-f1f9-4926-a5f2-4afa67c8601b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:33.798528 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1bdee-f1f9-4926-a5f2-4afa67c8601b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:33.802461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e2cb7-bbfc-45b4-873f-1ae8f7858ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:33.803092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2cb7-bbfc-45b4-873f-1ae8f7858ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:33.803371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2cb7-bbfc-45b4-873f-1ae8f7858ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:33.803645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2cb7-bbfc-45b4-873f-1ae8f7858ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:33.812503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e2cb7-bbfc-45b4-873f-1ae8f7858ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:33.814717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e2cb7-bbfc-45b4-873f-1ae8f7858ec7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:33.823996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 715/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:35.911489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e375977-918a-4c2e-a184-e9aedcb5c2d8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:35.911930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e375977-918a-4c2e-a184-e9aedcb5c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:35.912026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e375977-918a-4c2e-a184-e9aedcb5c2d8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:35.913397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:35.918553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd11e-3c90-40e9-b31a-788352df4e0a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:35.918933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd11e-3c90-40e9-b31a-788352df4e0a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:35.919109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd11e-3c90-40e9-b31a-788352df4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:35.925229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=79 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:35.937531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7f0cd11e-3c90-40e9-b31a-788352df4e0a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:35.939135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7f0cd11e-3c90-40e9-b31a-788352df4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:35.947038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:35.985442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e375977-918a-4c2e-a184-e9aedcb5c2d8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:35.990734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=73 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:35.996341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e375977-918a-4c2e-a184-e9aedcb5c2d8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:35.999872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c0633-778d-4a06-98a8-a5089b78c127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:36.002119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c0633-778d-4a06-98a8-a5089b78c127 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:36.002119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c0633-778d-4a06-98a8-a5089b78c127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:36.002119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c0633-778d-4a06-98a8-a5089b78c127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:36.009678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c0633-778d-4a06-98a8-a5089b78c127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:36.011126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c0633-778d-4a06-98a8-a5089b78c127 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:36.021008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 748/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:38.097081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec973f-d3c8-41ed-92a4-2909fcd74921 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:38.097661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec973f-d3c8-41ed-92a4-2909fcd74921 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:38.097661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec973f-d3c8-41ed-92a4-2909fcd74921 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:38.099086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:38.104218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180961b5-9a12-41ee-b777-35c0aec356a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:38.104627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180961b5-9a12-41ee-b777-35c0aec356a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:38.104777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180961b5-9a12-41ee-b777-35c0aec356a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:38.123068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-180961b5-9a12-41ee-b777-35c0aec356a7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:38.124267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-180961b5-9a12-41ee-b777-35c0aec356a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:38.132881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:38.169104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec973f-d3c8-41ed-92a4-2909fcd74921 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:38.180763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec973f-d3c8-41ed-92a4-2909fcd74921 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:38.184340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544974a-82e3-44aa-9457-04a24e053ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:38.185000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544974a-82e3-44aa-9457-04a24e053ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:38.185288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544974a-82e3-44aa-9457-04a24e053ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:38.185567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544974a-82e3-44aa-9457-04a24e053ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:38.194537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544974a-82e3-44aa-9457-04a24e053ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:38.195977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544974a-82e3-44aa-9457-04a24e053ec0 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:38.210593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 718/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:21:40.273451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc2eb-0322-4168-8564-cd9e7cbdc40c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:40.274045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc2eb-0322-4168-8564-cd9e7cbdc40c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:40.274045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc2eb-0322-4168-8564-cd9e7cbdc40c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:40.275415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:40.280710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e97f1d-5daa-4911-ad64-95f4a9de20f0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:40.281095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e97f1d-5daa-4911-ad64-95f4a9de20f0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:40.281286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e97f1d-5daa-4911-ad64-95f4a9de20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:40.299663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c6e97f1d-5daa-4911-ad64-95f4a9de20f0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:40.300852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c6e97f1d-5daa-4911-ad64-95f4a9de20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:40.308857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:40.344048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcc2eb-0322-4168-8564-cd9e7cbdc40c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:40.355187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcc2eb-0322-4168-8564-cd9e7cbdc40c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:40.358656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0cf82-5159-411f-902c-0f90c4580696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:40.359287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0cf82-5159-411f-902c-0f90c4580696 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:40.359573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0cf82-5159-411f-902c-0f90c4580696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:40.359852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0cf82-5159-411f-902c-0f90c4580696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:40.369210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0cf82-5159-411f-902c-0f90c4580696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:40.370630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0cf82-5159-411f-902c-0f90c4580696 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:40.380182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 751/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:50.294161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=11 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:50.376152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=14 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:00.416263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8c1b-ba6b-4497-bcd0-38ed2d57aa77 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:00.416875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8c1b-ba6b-4497-bcd0-38ed2d57aa77 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:00.416875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8c1b-ba6b-4497-bcd0-38ed2d57aa77 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:00.418243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 720/1471] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:00.423690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86729-c612-4ed5-9b3b-96da0b4e6dc9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:00.424129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86729-c612-4ed5-9b3b-96da0b4e6dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:00.424239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86729-c612-4ed5-9b3b-96da0b4e6dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:00.442297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-55b86729-c612-4ed5-9b3b-96da0b4e6dc9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:00.443503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55b86729-c612-4ed5-9b3b-96da0b4e6dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:00.451181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 752/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:00.498096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75c39d-321e-4f43-9705-cd2af86af93d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:00.498382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75c39d-321e-4f43-9705-cd2af86af93d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:00.498658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75c39d-321e-4f43-9705-cd2af86af93d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:00.500015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 721/1473] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jun 20 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:00.505260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59526a0-3c57-4b3c-b6d8-a417ecd39be6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:00.505553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59526a0-3c57-4b3c-b6d8-a417ecd39be6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:00.505834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59526a0-3c57-4b3c-b6d8-a417ecd39be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:00.524111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c59526a0-3c57-4b3c-b6d8-a417ecd39be6 None None] MFA Rules not processed for user `f2124f6539264fa3a4b0ec190e23b2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:00.525300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c59526a0-3c57-4b3c-b6d8-a417ecd39be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:00.531803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 753/1474] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jun 20 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:00.538791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75c39d-321e-4f43-9705-cd2af86af93d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:00.549350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75c39d-321e-4f43-9705-cd2af86af93d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:00.553116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb5e3-f7f6-49cf-8f05-781410a61bb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:00.553724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb5e3-f7f6-49cf-8f05-781410a61bb3 service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:00.554020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb5e3-f7f6-49cf-8f05-781410a61bb3 service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:00.554300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb5e3-f7f6-49cf-8f05-781410a61bb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:00.563570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb5e3-f7f6-49cf-8f05-781410a61bb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:00.564960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb5e3-f7f6-49cf-8f05-781410a61bb3 service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:00.574406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 722/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:22:02.702772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad53e8-2719-4342-b1e3-7b48546c937a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:02.703334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad53e8-2719-4342-b1e3-7b48546c937a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:02.703334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad53e8-2719-4342-b1e3-7b48546c937a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:02.704735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 754/1476] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:02.710208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbbf6d-e6b0-4721-b621-46bf15faf03f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:02.710672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbbf6d-e6b0-4721-b621-46bf15faf03f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:02.710859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbbf6d-e6b0-4721-b621-46bf15faf03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:02.729496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-10bbbf6d-e6b0-4721-b621-46bf15faf03f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:02.730738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-10bbbf6d-e6b0-4721-b621-46bf15faf03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:02.740171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 723/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:22:02.763061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad53e8-2719-4342-b1e3-7b48546c937a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:02.775413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad53e8-2719-4342-b1e3-7b48546c937a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:02.779835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:02.780480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:02.780765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:02.781043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:02.782295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:02.784054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:02.784054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:22:02.784054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:22:02.785191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08db7b6-bcfb-4790-9c87-da981b75bc78 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:02.804796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 755/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jun 20 12:22:02 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:04.856811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4270ead-5c26-4356-901a-466d9805196b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:04.857447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4270ead-5c26-4356-901a-466d9805196b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:04.857447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4270ead-5c26-4356-901a-466d9805196b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:04.858799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 724/1479] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:04.863976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4307c4-2c90-4c30-b13e-f5e9acf86f27 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:04.864375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4307c4-2c90-4c30-b13e-f5e9acf86f27 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:04.864569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4307c4-2c90-4c30-b13e-f5e9acf86f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:04.882860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe4307c4-2c90-4c30-b13e-f5e9acf86f27 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:04.884061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe4307c4-2c90-4c30-b13e-f5e9acf86f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:04.892404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 756/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:04.935174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4270ead-5c26-4356-901a-466d9805196b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:04.949220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4270ead-5c26-4356-901a-466d9805196b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:04.954983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847fd72-d6f3-41c0-8e49-0d6b42d57481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:04.955620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847fd72-d6f3-41c0-8e49-0d6b42d57481 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:04.955903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847fd72-d6f3-41c0-8e49-0d6b42d57481 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:04.956182 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847fd72-d6f3-41c0-8e49-0d6b42d57481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:04.964596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847fd72-d6f3-41c0-8e49-0d6b42d57481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:04.966260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847fd72-d6f3-41c0-8e49-0d6b42d57481 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:04.977366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 725/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:07.199089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be082c-d7f0-4f46-9c33-8ac92cbbb4b6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:07.199632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be082c-d7f0-4f46-9c33-8ac92cbbb4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:07.199632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be082c-d7f0-4f46-9c33-8ac92cbbb4b6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:07.201013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 757/1482] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:07.206251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d5611-95da-40d6-a63f-f0fc7e57fe9a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:07.206695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d5611-95da-40d6-a63f-f0fc7e57fe9a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:07.206815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d5611-95da-40d6-a63f-f0fc7e57fe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:07.224749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-178d5611-95da-40d6-a63f-f0fc7e57fe9a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:07.225953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-178d5611-95da-40d6-a63f-f0fc7e57fe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:07.233888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 726/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:07.270112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be082c-d7f0-4f46-9c33-8ac92cbbb4b6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:07.280711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be082c-d7f0-4f46-9c33-8ac92cbbb4b6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:07.284735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e50f5-6eb2-479b-acd1-070690a411fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:07.285366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e50f5-6eb2-479b-acd1-070690a411fb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:07.285651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e50f5-6eb2-479b-acd1-070690a411fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:07.285929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e50f5-6eb2-479b-acd1-070690a411fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:07.294651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e50f5-6eb2-479b-acd1-070690a411fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:07.296075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e50f5-6eb2-479b-acd1-070690a411fb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:07.306261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 758/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:09.379424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ab7c4-25dc-4851-bf9a-81b8ddbde24b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:09.379966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ab7c4-25dc-4851-bf9a-81b8ddbde24b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:09.379966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ab7c4-25dc-4851-bf9a-81b8ddbde24b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:09.381284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 727/1485] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:09.386610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44babbb-0251-4d4d-8f30-23b47f5d051a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:09.387037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44babbb-0251-4d4d-8f30-23b47f5d051a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:09.387154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44babbb-0251-4d4d-8f30-23b47f5d051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:09.404671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e44babbb-0251-4d4d-8f30-23b47f5d051a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:09.405855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e44babbb-0251-4d4d-8f30-23b47f5d051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:09.414181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 759/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:09.452128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ab7c4-25dc-4851-bf9a-81b8ddbde24b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:09.462851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ab7c4-25dc-4851-bf9a-81b8ddbde24b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:09.466379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43e72e-b23a-4abe-96b5-7b15358a4b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:09.467003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e72e-b23a-4abe-96b5-7b15358a4b8a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:09.467285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e72e-b23a-4abe-96b5-7b15358a4b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:09.467561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43e72e-b23a-4abe-96b5-7b15358a4b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:09.476879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43e72e-b23a-4abe-96b5-7b15358a4b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:09.478354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43e72e-b23a-4abe-96b5-7b15358a4b8a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:09.488152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 728/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:11.680612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305084d-9a5c-4705-8de3-f3509df2e2e3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:11.681179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305084d-9a5c-4705-8de3-f3509df2e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:11.681179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305084d-9a5c-4705-8de3-f3509df2e2e3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:11.682870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 760/1488] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:11.688687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6dea8-9b24-4cb7-b932-de9d3ba7cc44 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:11.689130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6dea8-9b24-4cb7-b932-de9d3ba7cc44 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:11.689250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6dea8-9b24-4cb7-b932-de9d3ba7cc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:11.707284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a5a6dea8-9b24-4cb7-b932-de9d3ba7cc44 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:11.708469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5a6dea8-9b24-4cb7-b932-de9d3ba7cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:11.716208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 729/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:11.757552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305084d-9a5c-4705-8de3-f3509df2e2e3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:11.768851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305084d-9a5c-4705-8de3-f3509df2e2e3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:11.772376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e7c9-1780-44a3-9bf1-c6521e0815d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:11.773014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e7c9-1780-44a3-9bf1-c6521e0815d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:11.773303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e7c9-1780-44a3-9bf1-c6521e0815d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:11.773587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e7c9-1780-44a3-9bf1-c6521e0815d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:11.782521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e7c9-1780-44a3-9bf1-c6521e0815d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:11.783957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e7c9-1780-44a3-9bf1-c6521e0815d4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:11.793309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 761/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:14.267220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa511-b6af-4b91-b76d-0801a754bd2e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:14.267220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa511-b6af-4b91-b76d-0801a754bd2e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:14.267220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa511-b6af-4b91-b76d-0801a754bd2e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:14.267979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 730/1491] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jun 20 12:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:14.272801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72e2a6-ef7e-43bd-9587-0cf7e3efc385 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:14.273197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72e2a6-ef7e-43bd-9587-0cf7e3efc385 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:14.273356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72e2a6-ef7e-43bd-9587-0cf7e3efc385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:14.291609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6d72e2a6-ef7e-43bd-9587-0cf7e3efc385 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:14.292914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6d72e2a6-ef7e-43bd-9587-0cf7e3efc385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:14.300677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 762/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jun 20 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:14.339810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fa511-b6af-4b91-b76d-0801a754bd2e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:14.350991 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fa511-b6af-4b91-b76d-0801a754bd2e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:14.354535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd3165-3b41-42a0-99c6-657aae09221e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:14.355164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3165-3b41-42a0-99c6-657aae09221e service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:14.355451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3165-3b41-42a0-99c6-657aae09221e service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:14.355733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3165-3b41-42a0-99c6-657aae09221e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:14.364645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd3165-3b41-42a0-99c6-657aae09221e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:14.366114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd3165-3b41-42a0-99c6-657aae09221e service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:14.375441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 731/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:24.286258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=33 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:24.371293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=33 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:03.612653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.613273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.613273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.631444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:03.632697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:03.641226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 763/1494] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:03.650789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.651303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.651415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.669717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:03.673428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:03.679109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 732/1495] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:03.683694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:03.693706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd37f32-fb16-446c-82ab-0066da87d126 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:03.698337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:03.702101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.702101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.702101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.702101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:03.702101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:03.702573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:03.702573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:24:03.702573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:24:03.702913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:03.714296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 764/1496] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:03.722346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:03.731471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810434e5-0c51-4099-b758-c74a5880d0cb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:03.736232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:03.736891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.737178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.737461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.738222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:03.739979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:03.739979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:24:03.739979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:24:03.741210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:03.899188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 733/1497] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:03 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:03.903572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:03.913422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b1be-c930-431b-9969-69c6fc692f83 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:03.968280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:03.968961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.969230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.969512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.970220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:03.971233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:03.971233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:24:03.971233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:24:03.972441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.086589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 765/1498] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:03 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:04.090775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.101231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9d44-516a-441a-8ce2-1f5a65f772c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.105882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.106746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.107030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.107371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.108744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.109789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:04.109789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:24:04.109789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:24:04.110723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.124969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 734/1499] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:04.128931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.139040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b3bb9-8cb5-4c1d-aadc-d48955318d82 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.143755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.144411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.144699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.144979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.145739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.146819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:04.146819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:24:04.146819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:24:04.147721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653051-f1a8-47ed-8a6d-3cfee64fefaa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.160866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 766/1500] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:04.164825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.175198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b315-bc5b-4644-a30b-6b15751cc8ed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.180042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.180914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.181202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.181486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] PATH_INFO: `/v3/projects/e5e668bfda4f4f64a3195338ec187d1d/users/29be216b05e5498891d5b35470d75ddd/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.196595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e668bfda4f4f64a3195338ec187d1d, user_id=29be216b05e5498891d5b35470d75ddd, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.197644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:04.197644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:24:04.197644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:24:04.199639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a7c3-7c87-484f-91a5-0ad6dc4f9579 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.291188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 735/1501] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:04 2022] PUT /identity/v3/projects/e5e668bfda4f4f64a3195338ec187d1d/users/29be216b05e5498891d5b35470d75ddd/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:04.302828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edb805-08b7-4b2a-97c5-8c521c2ae119 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.303400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edb805-08b7-4b2a-97c5-8c521c2ae119 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.303704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edb805-08b7-4b2a-97c5-8c521c2ae119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.330505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-32edb805-08b7-4b2a-97c5-8c521c2ae119 None None] MFA Rules not processed for user `29be216b05e5498891d5b35470d75ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:04.333823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-32edb805-08b7-4b2a-97c5-8c521c2ae119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:04.403574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 767/1502] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:04.417439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9cbac-cefb-4218-8026-60e9886d5517 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.417677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9cbac-cefb-4218-8026-60e9886d5517 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.417961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9cbac-cefb-4218-8026-60e9886d5517 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.419394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 736/1503] 10.222.0.70 () {54 vars in 963 bytes} [Mon Jun 20 12:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:24:04.425027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37049b6-c588-464f-bbca-4f7054c6c196 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.425323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37049b6-c588-464f-bbca-4f7054c6c196 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.425612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37049b6-c588-464f-bbca-4f7054c6c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.443319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f37049b6-c588-464f-bbca-4f7054c6c196 None None] MFA Rules not processed for user `f08d1a5b8e594901b986f1bde71e015a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:04.444510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f37049b6-c588-464f-bbca-4f7054c6c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:04.487797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:04.495055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 768/1504] 10.222.0.70 () {58 vars in 1060 bytes} [Mon Jun 20 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:04.502623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9cbac-cefb-4218-8026-60e9886d5517 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.513033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9cbac-cefb-4218-8026-60e9886d5517 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.520108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.520736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.521013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.521285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.529383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.533016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.539962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 737/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:04.585274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6f0d5-b6ca-4270-8c9b-21181b249efd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.585706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6f0d5-b6ca-4270-8c9b-21181b249efd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.586198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6f0d5-b6ca-4270-8c9b-21181b249efd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.587554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 769/1506] 10.222.0.70 () {52 vars in 829 bytes} [Mon Jun 20 12:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:24:04.591135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.659021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21802d1e-5712-4f44-a3f8-e724b6017575 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.663727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.664600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.664878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.665151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] PATH_INFO: `/v3/users/29be216b05e5498891d5b35470d75ddd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.666369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29be216b05e5498891d5b35470d75ddd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.667431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:04.667431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:24:04.667431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:24:04.668684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:05.012020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29be216b05e5498891d5b35470d75ddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.030485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29be216b05e5498891d5b35470d75ddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.115235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29be216b05e5498891d5b35470d75ddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.125375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:05.129674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29be216b05e5498891d5b35470d75ddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.130404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29be216b05e5498891d5b35470d75ddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.136602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 738/1507] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:04 2022] DELETE /identity/v3/users/29be216b05e5498891d5b35470d75ddd => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:05.141514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:05.141973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:05.142174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:05.159396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:05.162150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:05.218575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 770/1508] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:05.237022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:05.237022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:05.293350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ff80-9277-4f8d-a3ba-e2b025a2d66a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:05.297956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667aee-6501-4be9-910f-3abe0e992947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:05.298632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667aee-6501-4be9-910f-3abe0e992947 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:05.298925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667aee-6501-4be9-910f-3abe0e992947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:05.299205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667aee-6501-4be9-910f-3abe0e992947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:05.310204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667aee-6501-4be9-910f-3abe0e992947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:05.310379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667aee-6501-4be9-910f-3abe0e992947 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:05.337115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 739/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:05.865175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:05.866718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:05.879484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bababc20-59c7-4ad0-ac92-ee9ce4131469 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:05.884129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:05.884924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:05.885211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:05.885488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] PATH_INFO: `/v3/projects/e5e668bfda4f4f64a3195338ec187d1d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:05.886747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e668bfda4f4f64a3195338ec187d1d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:05.887759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:24:05.887759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:24:05.887759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:24:05.888936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.033912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e668bfda4f4f64a3195338ec187d1d', 'request_id': 'req-bba699fe-b9dd-4598-b177-29a9df18814b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.143962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e668bfda4f4f64a3195338ec187d1d', 'request_id': 'req-bba699fe-b9dd-4598-b177-29a9df18814b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.158674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e668bfda4f4f64a3195338ec187d1d', 'request_id': 'req-bba699fe-b9dd-4598-b177-29a9df18814b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.169923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] The token cache is being invalidate because project e5e668bfda4f4f64a3195338ec187d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:06.170258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.171957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bba699fe-b9dd-4598-b177-29a9df18814b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.173278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 771/1510] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:05 2022] DELETE /identity/v3/projects/e5e668bfda4f4f64a3195338ec187d1d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:15.331056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=29 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:16.166455 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:54.704868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0979-5b6f-479c-86f0-beea15ad2ad9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:54.705472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0979-5b6f-479c-86f0-beea15ad2ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:54.705472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0979-5b6f-479c-86f0-beea15ad2ad9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:54.706864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 740/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:25:54.711927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2451e7-73b2-4b12-8962-068de9d680c1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:54.712427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2451e7-73b2-4b12-8962-068de9d680c1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:54.712532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2451e7-73b2-4b12-8962-068de9d680c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:54.731168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9d2451e7-73b2-4b12-8962-068de9d680c1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:54.732390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d2451e7-73b2-4b12-8962-068de9d680c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:54.790560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 772/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:54.945974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e0979-5b6f-479c-86f0-beea15ad2ad9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:54.947715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d61e0979-5b6f-479c-86f0-beea15ad2ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:55.022422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e0979-5b6f-479c-86f0-beea15ad2ad9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:55.028393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae85a8-e6b9-4b01-98a1-7756f3d6e16c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:55.029035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae85a8-e6b9-4b01-98a1-7756f3d6e16c service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:55.029324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae85a8-e6b9-4b01-98a1-7756f3d6e16c service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:55.029605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae85a8-e6b9-4b01-98a1-7756f3d6e16c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:55.038584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae85a8-e6b9-4b01-98a1-7756f3d6e16c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:55.040252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae85a8-e6b9-4b01-98a1-7756f3d6e16c service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:55.051069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 741/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:55.896797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3db30-9cd4-4a00-a9a5-2298b1db6998 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:55.897810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3db30-9cd4-4a00-a9a5-2298b1db6998 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:55.898664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3db30-9cd4-4a00-a9a5-2298b1db6998 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:55.900046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 773/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:25:55.904893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3427169-3302-4054-9abe-dd42f373a7b6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:55.905282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3427169-3302-4054-9abe-dd42f373a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:55.905452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3427169-3302-4054-9abe-dd42f373a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:55.923921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b3427169-3302-4054-9abe-dd42f373a7b6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:55.925168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b3427169-3302-4054-9abe-dd42f373a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:55.933347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 742/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:56.085557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3db30-9cd4-4a00-a9a5-2298b1db6998 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:56.101419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3db30-9cd4-4a00-a9a5-2298b1db6998 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:56.107666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd72e9b-23f6-4fff-a683-0cc26ee5dc62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:56.108326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd72e9b-23f6-4fff-a683-0cc26ee5dc62 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:56.108613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd72e9b-23f6-4fff-a683-0cc26ee5dc62 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:56.108896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd72e9b-23f6-4fff-a683-0cc26ee5dc62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:56.118388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd72e9b-23f6-4fff-a683-0cc26ee5dc62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:56.119993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd72e9b-23f6-4fff-a683-0cc26ee5dc62 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:56.129408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 774/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:56.991575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11d99-1473-4799-9156-bb30b0e68dc6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:56.992025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11d99-1473-4799-9156-bb30b0e68dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:56.992132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11d99-1473-4799-9156-bb30b0e68dc6 None None] PATH_INFO: `/v3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:56.993457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 743/1517] 10.222.0.66 () {54 vars in 925 bytes} [Mon Jun 20 12:25:56 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:25:56.999968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ddae-3317-4c4a-a14a-f25eed128a44 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:57.000508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ddae-3317-4c4a-a14a-f25eed128a44 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:57.000619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ddae-3317-4c4a-a14a-f25eed128a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:57.019264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d6e5ddae-3317-4c4a-a14a-f25eed128a44 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:57.020647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6e5ddae-3317-4c4a-a14a-f25eed128a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:57.083670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 775/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jun 20 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:01.142291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b9657-3171-47d9-8d96-67a3df2246ce None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:01.142741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b9657-3171-47d9-8d96-67a3df2246ce None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:01.142842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b9657-3171-47d9-8d96-67a3df2246ce None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:01.144195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 744/1519] 10.222.0.70 () {54 vars in 960 bytes} [Mon Jun 20 12:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:01.149063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4d18-16f4-4dc1-900d-3cb97e9f2429 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:01.149512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4d18-16f4-4dc1-900d-3cb97e9f2429 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:01.149635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4d18-16f4-4dc1-900d-3cb97e9f2429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:01.169449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-158e4d18-16f4-4dc1-900d-3cb97e9f2429 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:01.170658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-158e4d18-16f4-4dc1-900d-3cb97e9f2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:01.180124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 776/1520] 10.222.0.70 () {58 vars in 1057 bytes} [Mon Jun 20 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:01.187542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b9657-3171-47d9-8d96-67a3df2246ce None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:01.200967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b9657-3171-47d9-8d96-67a3df2246ce None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:01.205922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2102-338d-49f2-b295-1693421c2786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:01.206586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2102-338d-49f2-b295-1693421c2786 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:01.206873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2102-338d-49f2-b295-1693421c2786 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:01.207155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2102-338d-49f2-b295-1693421c2786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:01.215918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2102-338d-49f2-b295-1693421c2786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:01.217527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2102-338d-49f2-b295-1693421c2786 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:01.227745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 745/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:07.372880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cbaf2-ec93-411c-b9ed-088062e803fe None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:07.373447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cbaf2-ec93-411c-b9ed-088062e803fe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:07.373447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cbaf2-ec93-411c-b9ed-088062e803fe None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:07.374741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 777/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:07.379606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc014-3a83-4104-84c0-22b822ab46fb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:07.380082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc014-3a83-4104-84c0-22b822ab46fb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:07.380197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc014-3a83-4104-84c0-22b822ab46fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:07.400709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f51cc014-3a83-4104-84c0-22b822ab46fb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:07.401921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f51cc014-3a83-4104-84c0-22b822ab46fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:07.410104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 746/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:07.564060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cbaf2-ec93-411c-b9ed-088062e803fe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:07.578717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cbaf2-ec93-411c-b9ed-088062e803fe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:07.584061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670226-c96e-4e67-975b-5580df6f826c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:07.585302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670226-c96e-4e67-975b-5580df6f826c service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:07.585583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670226-c96e-4e67-975b-5580df6f826c service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:07.585855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670226-c96e-4e67-975b-5580df6f826c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:07.593890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f670226-c96e-4e67-975b-5580df6f826c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:07.595518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f670226-c96e-4e67-975b-5580df6f826c service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:07.604759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 778/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:08.436813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1a72-bb3e-4e77-b753-2a1868dd4304 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:08.437374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1a72-bb3e-4e77-b753-2a1868dd4304 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:08.437374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1a72-bb3e-4e77-b753-2a1868dd4304 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:08.438865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 747/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:08.443950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca460-cfb5-4d25-b84c-b8132d3abe88 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:08.444384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca460-cfb5-4d25-b84c-b8132d3abe88 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:08.444515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca460-cfb5-4d25-b84c-b8132d3abe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:08.461977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-91dca460-cfb5-4d25-b84c-b8132d3abe88 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:08.463215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91dca460-cfb5-4d25-b84c-b8132d3abe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:08.471094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 779/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:08.633756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1a72-bb3e-4e77-b753-2a1868dd4304 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:08.648230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1a72-bb3e-4e77-b753-2a1868dd4304 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:08.653630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a8bd-9e93-498c-9ada-fd4a6321033d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:08.654303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a8bd-9e93-498c-9ada-fd4a6321033d service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:08.654587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a8bd-9e93-498c-9ada-fd4a6321033d service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:08.654866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a8bd-9e93-498c-9ada-fd4a6321033d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:08.663517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4a8bd-9e93-498c-9ada-fd4a6321033d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:08.665126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4a8bd-9e93-498c-9ada-fd4a6321033d service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:08.674511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 748/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:12.720180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c4af-ed18-490a-a0bd-442ff709bf43 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:12.720754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c4af-ed18-490a-a0bd-442ff709bf43 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:12.720754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c4af-ed18-490a-a0bd-442ff709bf43 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:12.722120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 780/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:12.727557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a46d-228d-427a-a275-73df5ee856de None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:12.728021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a46d-228d-427a-a275-73df5ee856de None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:12.728141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a46d-228d-427a-a275-73df5ee856de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:12.747325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6556a46d-228d-427a-a275-73df5ee856de None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:12.748524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6556a46d-228d-427a-a275-73df5ee856de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:12.757012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 749/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:12.792438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c4af-ed18-490a-a0bd-442ff709bf43 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:12.794134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5b96c4af-ed18-490a-a0bd-442ff709bf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:12.857881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c4af-ed18-490a-a0bd-442ff709bf43 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:12.857881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d84c-5cb0-4a8f-a03d-ad30b0bfddcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:12.857881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d84c-5cb0-4a8f-a03d-ad30b0bfddcb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:12.857881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d84c-5cb0-4a8f-a03d-ad30b0bfddcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:12.858491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d84c-5cb0-4a8f-a03d-ad30b0bfddcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:12.866829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d84c-5cb0-4a8f-a03d-ad30b0bfddcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:12.868373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d84c-5cb0-4a8f-a03d-ad30b0bfddcb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:12.877724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:12.884193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 781/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:14.904034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9327d-4d88-41f8-ac22-97bc0e63e9e5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:14.904622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9327d-4d88-41f8-ac22-97bc0e63e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:14.904622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9327d-4d88-41f8-ac22-97bc0e63e9e5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:14.906215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 750/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:14.911229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5948724-715f-41a7-a827-0f110dee7911 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:14.911653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5948724-715f-41a7-a827-0f110dee7911 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:14.911785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5948724-715f-41a7-a827-0f110dee7911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:14.930648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c5948724-715f-41a7-a827-0f110dee7911 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:14.931840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c5948724-715f-41a7-a827-0f110dee7911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:14.939601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 782/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:14.974705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9327d-4d88-41f8-ac22-97bc0e63e9e5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:14.985793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9327d-4d88-41f8-ac22-97bc0e63e9e5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:14.989256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883b9a0-4061-49a0-acfa-6a3beb17844f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:14.989887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883b9a0-4061-49a0-acfa-6a3beb17844f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:14.990439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883b9a0-4061-49a0-acfa-6a3beb17844f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:14.990556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883b9a0-4061-49a0-acfa-6a3beb17844f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:14.999246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883b9a0-4061-49a0-acfa-6a3beb17844f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:15.000675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883b9a0-4061-49a0-acfa-6a3beb17844f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:15.010145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 751/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:26:18.643553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067b28a-f135-43ba-a428-be308bbcb1a3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:18.644125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067b28a-f135-43ba-a428-be308bbcb1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:18.644125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067b28a-f135-43ba-a428-be308bbcb1a3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:18.645468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 783/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:18.650653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f094ea-8683-43c7-8733-9f82b6db2ace None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:18.651034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f094ea-8683-43c7-8733-9f82b6db2ace None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:18.651248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f094ea-8683-43c7-8733-9f82b6db2ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:18.657613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=62 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:18.669574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d0f094ea-8683-43c7-8733-9f82b6db2ace None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:18.673903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d0f094ea-8683-43c7-8733-9f82b6db2ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:18.679177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 752/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:18.984185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067b28a-f135-43ba-a428-be308bbcb1a3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:18.985875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4067b28a-f135-43ba-a428-be308bbcb1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:19.044039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067b28a-f135-43ba-a428-be308bbcb1a3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.047753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d19f4-fdbd-4b13-8fa3-aefe49aef5e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.048406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d19f4-fdbd-4b13-8fa3-aefe49aef5e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.048695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d19f4-fdbd-4b13-8fa3-aefe49aef5e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.048980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d19f4-fdbd-4b13-8fa3-aefe49aef5e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.059323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d19f4-fdbd-4b13-8fa3-aefe49aef5e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.060769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d19f4-fdbd-4b13-8fa3-aefe49aef5e8 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.070681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 784/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:21.157268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5a9f-3f13-41a1-a13c-f9a5bd1957c7 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:21.157799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5a9f-3f13-41a1-a13c-f9a5bd1957c7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:21.157906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5a9f-3f13-41a1-a13c-f9a5bd1957c7 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:21.159255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 753/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:26:21.164490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf58468-aa8e-4568-a5f1-6e936ee59479 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:21.164926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf58468-aa8e-4568-a5f1-6e936ee59479 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:21.165065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf58468-aa8e-4568-a5f1-6e936ee59479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:21.183650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9cf58468-aa8e-4568-a5f1-6e936ee59479 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:21.184851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9cf58468-aa8e-4568-a5f1-6e936ee59479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:21.192952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 785/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:21.497113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5a9f-3f13-41a1-a13c-f9a5bd1957c7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:21.498852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-595b5a9f-3f13-41a1-a13c-f9a5bd1957c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:21.511821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5a9f-3f13-41a1-a13c-f9a5bd1957c7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:21.515422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55de36-9393-4a4c-9bf6-df936245047d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:21.516050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55de36-9393-4a4c-9bf6-df936245047d service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:21.516337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55de36-9393-4a4c-9bf6-df936245047d service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:21.516617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55de36-9393-4a4c-9bf6-df936245047d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:21.526158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55de36-9393-4a4c-9bf6-df936245047d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:21.527588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55de36-9393-4a4c-9bf6-df936245047d service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:21.536952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 754/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:31.177921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=32 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:31.532771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:58.528897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.529867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.530343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:58.557745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:58.559000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:58.572286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 786/1540] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:58.581823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.582417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.582417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:58.611927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:58.613145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:58.628691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 755/1541] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:58.633874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:58.649140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb135cd-9ee9-4329-9513-7c913cc6f869 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:58.654296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:58.654974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.655265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.655550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:58.656287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:58.656606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:58.662297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:58.675417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 787/1542] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:58.684256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:58.694115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961f97-05e1-41c2-9535-19c4145b0e51 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:58.706084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba6da-240e-479a-a679-b26edc02a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:58.706752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba6da-240e-479a-a679-b26edc02a76f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.707035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba6da-240e-479a-a679-b26edc02a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.707312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba6da-240e-479a-a679-b26edc02a76f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:58.708015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba6da-240e-479a-a679-b26edc02a76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:58.709939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba6da-240e-479a-a679-b26edc02a76f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:58.800088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 756/1543] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:27:58 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:27:58.803961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:58.815077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41fb56-70b9-4132-8bf5-870d7b5dd7c7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:58.894467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:58.895161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.895452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.895734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:58.896457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:58.898490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:58.906765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e59ec-71fd-44c0-9a38-f92702b9d771 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.907201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e59ec-71fd-44c0-9a38-f92702b9d771 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.907623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e59ec-71fd-44c0-9a38-f92702b9d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:58.948417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-791e59ec-71fd-44c0-9a38-f92702b9d771 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:58.949652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-791e59ec-71fd-44c0-9a38-f92702b9d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:58.968227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 757/1544] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:27:58.978717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:58.979071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:58.979348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.011267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.014193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.023539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 788/1545] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:27:58 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:27:59.024723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 758/1546] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:27:59.027760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.029520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.040685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ccee4-8ce2-4e37-8050-0f528f6ad805 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.060060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4ac0e-64a1-47ec-b623-25537aa609aa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.060252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.060252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.060252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.060252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.060615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.060615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.060615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:27:59.060615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:27:59.060615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:27:59.060985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.067667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.068362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.068652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.068939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.069744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.071516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.081479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 759/1547] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:27:59.089696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.094471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 789/1548] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:27:59.097628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.121633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a258-a719-4df0-a445-de742bc65df1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.125620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1cd0-81fe-4998-9742-233dcc880d79 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.139362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae8b4c-80f2-4a10-9ea6-a40623467c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.140050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae8b4c-80f2-4a10-9ea6-a40623467c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.140334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae8b4c-80f2-4a10-9ea6-a40623467c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.140609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae8b4c-80f2-4a10-9ea6-a40623467c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.141313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae8b4c-80f2-4a10-9ea6-a40623467c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.143516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae8b4c-80f2-4a10-9ea6-a40623467c1d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.146813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.147530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.147860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.148148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.148911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.150627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.181210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 790/1549] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:27:59.186052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.208648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b943d0-d36f-428a-879f-7eef59432e58 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.222962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.223887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.224182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.224506 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] PATH_INFO: `/v3/projects/4ccc87c53b7b4e279d8e8c73a914b1f2/users/04179e46107e46439962cba9192d0d2a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.250308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccc87c53b7b4e279d8e8c73a914b1f2, user_id=04179e46107e46439962cba9192d0d2a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.251372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:27:59.251372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:27:59.251372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:27:59.253983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea00a62-ee44-42e1-829f-8a3e15fe47e1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.328990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 760/1550] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:27:59.330498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6f88-391f-4aaf-b140-8cabd9258af6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.330861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6f88-391f-4aaf-b140-8cabd9258af6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.331301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6f88-391f-4aaf-b140-8cabd9258af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.349970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9b7d6f88-391f-4aaf-b140-8cabd9258af6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.351767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9b7d6f88-391f-4aaf-b140-8cabd9258af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.406044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 791/1551] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:27:59 2022] PUT /identity/v3/projects/4ccc87c53b7b4e279d8e8c73a914b1f2/users/04179e46107e46439962cba9192d0d2a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:27:59.407401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.407696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.407982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.416261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 761/1552] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.416836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be96a29-de7f-4b4c-8149-651fe500c37a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.417125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be96a29-de7f-4b4c-8149-651fe500c37a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.417406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be96a29-de7f-4b4c-8149-651fe500c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.436071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.437275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.437408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3be96a29-de7f-4b4c-8149-651fe500c37a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.438617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3be96a29-de7f-4b4c-8149-651fe500c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.496226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 762/1553] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.496449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 792/1554] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.497275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.498952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e53d8-22f6-4f86-8423-31ec81fc62d9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.499240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e53d8-22f6-4f86-8423-31ec81fc62d9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.499518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e53d8-22f6-4f86-8423-31ec81fc62d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.513716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716b3c-a907-436e-953d-81d45cfe8fbb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.517940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-218e53d8-22f6-4f86-8423-31ec81fc62d9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.518333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7c835-1fca-41c3-92f8-da1e4b247349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.519002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7c835-1fca-41c3-92f8-da1e4b247349 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.519170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-218e53d8-22f6-4f86-8423-31ec81fc62d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.519287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7c835-1fca-41c3-92f8-da1e4b247349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.519564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7c835-1fca-41c3-92f8-da1e4b247349 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.520254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7c835-1fca-41c3-92f8-da1e4b247349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.522219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7c835-1fca-41c3-92f8-da1e4b247349 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.527651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 763/1555] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.531145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269b35-9791-440b-8f2e-a9149d527b85 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.531145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269b35-9791-440b-8f2e-a9149d527b85 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.531145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269b35-9791-440b-8f2e-a9149d527b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.549280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-59269b35-9791-440b-8f2e-a9149d527b85 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.550555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-59269b35-9791-440b-8f2e-a9149d527b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.558711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 764/1556] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.559888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54200e-706f-4ad2-a614-9e4a9c50db42 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.560173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54200e-706f-4ad2-a614-9e4a9c50db42 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.560451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54200e-706f-4ad2-a614-9e4a9c50db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.578942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1a54200e-706f-4ad2-a614-9e4a9c50db42 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.580155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a54200e-706f-4ad2-a614-9e4a9c50db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.588431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 765/1557] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.589608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b1d21-ab1e-435a-94c4-8badab8be124 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.589888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b1d21-ab1e-435a-94c4-8badab8be124 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.590192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b1d21-ab1e-435a-94c4-8badab8be124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.597095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:59.610084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 793/1558] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:27:59.613675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba178-b457-4927-93fa-4b08c47aa665 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.613675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba178-b457-4927-93fa-4b08c47aa665 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.613675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba178-b457-4927-93fa-4b08c47aa665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.616227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-705b1d21-ab1e-435a-94c4-8badab8be124 None None] MFA Rules not processed for user `04179e46107e46439962cba9192d0d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.617458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-705b1d21-ab1e-435a-94c4-8badab8be124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.626960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:59.632912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1c6ba178-b457-4927-93fa-4b08c47aa665 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.634064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c6ba178-b457-4927-93fa-4b08c47aa665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.642289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 794/1559] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.648274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c774-cd18-4859-a04c-3c5a818c50e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.648274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c774-cd18-4859-a04c-3c5a818c50e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.648274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c774-cd18-4859-a04c-3c5a818c50e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.665660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3e68c774-cd18-4859-a04c-3c5a818c50e9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.666931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e68c774-cd18-4859-a04c-3c5a818c50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.675196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 795/1560] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.676436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0f9c5-fa6b-41ba-a02b-d6276c2f89b4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.676761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0f9c5-fa6b-41ba-a02b-d6276c2f89b4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.677068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0f9c5-fa6b-41ba-a02b-d6276c2f89b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.686183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 766/1561] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.687386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc247-aab5-4e9f-aae9-d1fd0831e029 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.687687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc247-aab5-4e9f-aae9-d1fd0831e029 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.687972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc247-aab5-4e9f-aae9-d1fd0831e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.695876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e7a0f9c5-fa6b-41ba-a02b-d6276c2f89b4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.697071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e7a0f9c5-fa6b-41ba-a02b-d6276c2f89b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.704866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 796/1562] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.705837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a7ecc247-aab5-4e9f-aae9-d1fd0831e029 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.707053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a7ecc247-aab5-4e9f-aae9-d1fd0831e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.718052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.718052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.718052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.718567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 767/1563] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.718567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.718567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.718567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.728058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.729369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.737408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 797/1564] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.741306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:59.741481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.741598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:59.746641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 768/1565] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:59.747682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bc3d-2576-4b67-918b-b9e024121a0c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.748017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.752803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.753465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.753754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.754070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.755237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.756416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.758550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e9b2-93f7-423c-880e-2bcbe5835004 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.763494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.764248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.764528 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.764802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.765525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.765839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.766639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 798/1566] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:27:59.767457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.767567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.777831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c03cd-91fc-4932-b82d-6554ec3bb566 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.780225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 769/1567] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:59.782563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.783222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.783871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.784157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.784434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.785155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.785488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.787089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.794220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd125-ac44-47bc-919a-a3500e976ea1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.798884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.799674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.800067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.800183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 799/1568] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:59.800355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.800963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.801074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.803007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.812409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824281c-0e5e-4536-a16a-b44e616d7205 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.817348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.817885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.818189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.818467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.819281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.820056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.821643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.833303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 800/1569] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:59.834145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.844325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae6208-8815-4b0f-8a25-593609a34c20 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.848811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.849423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.849705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.849979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.850726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.851041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.852574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.864100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 801/1570] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:59.864905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.874511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dd02-bebd-4cff-9ec1-56082af9dae2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.874698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 770/1571] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:27:59.875611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.933465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.934160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.934440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.934718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.935430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.935734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.937388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.937921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb66b6-49f0-44c3-9131-f945f25e5028 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.942905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.943556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.943843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.944128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.945491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:27:59.945803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.947434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.949297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 802/1572] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:59.950119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.959487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc68253-b024-40b8-8195-b94628aa1435 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.964648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.965288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.965572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.965849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.966598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.967265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 771/1573] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:27:59.968074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.968164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.981684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 803/1574] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:27:59.981684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:59.988438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0713-9187-4106-8c39-f9b359f5c4a7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.988438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.988438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.988438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.988855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.988855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.988855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:59.989521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5005a-4eec-4f4e-8b8e-dd76204287ae admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:59.994348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:59.994985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:59.995266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:59.995541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:59.996215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:59.997225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:27:59.997225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:27:59.997225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:27:59.998433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.088172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 772/1575] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.089036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.109733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:00.131486 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 804/1576] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:27:59 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.132855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.153295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbafb1-ad76-4afd-bcb9-01895bf1c486 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.186509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:00.197781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6593c-928a-4f8d-be37-66f447bcfa16 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.202569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.207218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.207218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.207218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.207218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.207218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.212469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.213133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.213437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.213697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.214422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.216352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.314191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 805/1577] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.315006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.355574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 773/1578] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/projects => generated 401 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.355574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.377289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0f45-96d3-48a9-8beb-062f9f89b96d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.409069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e1c1-19fd-487a-bca5-ebdc44c0870c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.418757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.418757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.418757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.418757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.419246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.419503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.439397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.440437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.440865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.441288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.442414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.445592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.527475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 774/1579] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.528436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.558894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 806/1580] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/users => generated 309 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.559979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.568911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:00.570536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034385f-52a8-446d-afb8-5623bdd9ba88 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.592936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e6d68-3846-4fca-b6b1-4b8f3bf7a59f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.597757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.598445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.598735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.599014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.599714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.601743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.627018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.627842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.628121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.628398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] PATH_INFO: `/v3/projects/3a2edf167c394063a3e96fe2705ee8c0/users/9ea06252769148759586242b0b5f562c/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.644262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2edf167c394063a3e96fe2705ee8c0, user_id=9ea06252769148759586242b0b5f562c, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.647003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.650583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:00.725267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 775/1581] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.726353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.759872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 807/1582] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:00 2022] PUT /identity/v3/projects/3a2edf167c394063a3e96fe2705ee8c0/users/9ea06252769148759586242b0b5f562c/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:00.761597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.797488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ceb3-8061-4f8a-8f58-85a8bf450eb9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.830453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b427b-cb16-4713-8704-7ac8e8ee22ae admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.835140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.836424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.836708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.836985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.837669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.839617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.855599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.856274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.856595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.856879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.857571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.858658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:28:00.858658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:28:00.858658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:28:00.863475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.943327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 808/1583] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/users => generated 282 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.944365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.954374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16ccd-ec62-4122-9d54-a6c0cdaf8ac1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.958923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.959559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.959844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.960121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.960793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.962740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:00.972017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 776/1584] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:00.972862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:00.988763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66a93-a281-4cbb-87c9-4bff5298a27e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:00.994514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:00.995180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.995463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.995740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.996430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:00.998408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.075628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 809/1585] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:01.076541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.086992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390e70-0b9e-4210-8149-ff869c02fe0d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.091785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc0089-d3c8-4c9e-93df-39a33f880744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.092433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc0089-d3c8-4c9e-93df-39a33f880744 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.092717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc0089-d3c8-4c9e-93df-39a33f880744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.092993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc0089-d3c8-4c9e-93df-39a33f880744 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.093703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc0089-d3c8-4c9e-93df-39a33f880744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.095686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc0089-d3c8-4c9e-93df-39a33f880744 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.141720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 777/1586] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:01.142745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.152433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a0404-4436-4305-b35d-ee47acb0531a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.156983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.157611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.157899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.158206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.158915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.160510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.170830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 778/1587] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.171564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.181463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097763d-497d-459c-800f-14fd34f967d1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.186026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.186645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.186926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.187237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.187855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.189694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.205532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 810/1588] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:01 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:01.206838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.207161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.207440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.224135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:01.225331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:01.232943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 811/1589] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:01.233702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.243416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81ce57-2124-4ae2-915d-ed7983b38a76 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.247876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.248520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.248802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.249075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.249790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.251419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.262078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 812/1590] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.262858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.272287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b92c2-204c-4d8e-a2c2-ed0eadc35e45 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.276963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.277608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.278042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.278336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.279108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.280717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.291033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 813/1591] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.291809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.300938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ede42-0467-4f03-a8c9-0cba91df9c63 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.306581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.307196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.307483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.307761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.308470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.310167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.320109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 814/1592] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.320889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.325026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 779/1593] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:01 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:01.326095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.332197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d7e3f-cd70-4ff3-a768-60b0136ba9e0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.339379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3b6cd-3726-443d-ba00-a5c2d86bd271 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.339554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.339554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.339554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.339554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.339962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.340869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.341354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.342239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.342524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.342809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] PATH_INFO: `/v3/projects/813ae067b9f34dd695cfa0311e909c5d/users/e0076dd9130b4bc09c58da3deb4f8517/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.351574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 815/1594] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.352363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.354917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:01.358909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813ae067b9f34dd695cfa0311e909c5d, user_id=e0076dd9130b4bc09c58da3deb4f8517, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.361613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.363165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fbc77-54ed-4d43-b36a-9ec01131bbf8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.368674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.369326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.369644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.369926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.370710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.372298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.382253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 816/1595] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.383100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.433710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:01.437435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8aa81-0327-40cb-9d5a-9b1c33b8ab30 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.441084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.441750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.442628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.442628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.451343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.452769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.462164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 817/1596] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:01.462886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.472038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 780/1597] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:01 2022] PUT /identity/v3/projects/813ae067b9f34dd695cfa0311e909c5d/users/e0076dd9130b4bc09c58da3deb4f8517/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:01.472038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.475242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7730fbd-0b86-46ef-9443-36731a6ca327 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.532252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495faacd-f375-4799-9463-09a30fbed6a9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.533532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.534236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.534522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.534800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.535523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.536929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.537148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.537589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.537872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.538775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.539475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.541083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.547540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 818/1598] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.548459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.551356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 781/1599] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.552115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.559662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a26f37-547b-4fd5-b1ac-3a8ff4bb5349 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.562432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e0a3-5fcd-4569-85b4-871b559e1395 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.564665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.568964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.568964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.568964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.568964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.569320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.569320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.569320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.569320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.569688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.569791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.570504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.580912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 819/1600] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.580912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.581199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 782/1601] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.581199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.588775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5358a-b5d1-465a-b615-bd73d4fa81cf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.593199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06c0ef-9248-421a-a4b7-727f38fc8234 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.593685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.594112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.594457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.594785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.595464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.597040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.598276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.598923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.599199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.599480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.600197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.602372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.608509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 820/1602] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.609416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.621491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 783/1603] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.621491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.621758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc531fe-48ee-4195-8fcd-a4204eae8ee3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.626270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.627141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.627726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.627726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.628537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.629427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca2aa4-8cc0-4696-b73a-03cafff9af27 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.630237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.635201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.636293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.636733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.637138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] PATH_INFO: `/v3/projects/cef0929fac2749cbaf66b53266efd434/users/b0530b2896ea43338ed7b9a02f337061/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.642412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 821/1604] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.643228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.653943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9d8c7-1784-4ad8-82f6-d8660f8d5b32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.655900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef0929fac2749cbaf66b53266efd434, user_id=b0530b2896ea43338ed7b9a02f337061, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.658746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.659172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.660190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.660540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.660891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] PATH_INFO: `/v3/projects/6d229d86d24441f38a3211c0e2c29eb4/users/f023004fda46413e878274519d68197c/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.676948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d229d86d24441f38a3211c0e2c29eb4, user_id=f023004fda46413e878274519d68197c, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.683823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.741067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 784/1605] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:01 2022] PUT /identity/v3/projects/cef0929fac2749cbaf66b53266efd434/users/b0530b2896ea43338ed7b9a02f337061/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:01.742005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.778233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 822/1606] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:01 2022] PUT /identity/v3/projects/6d229d86d24441f38a3211c0e2c29eb4/users/f023004fda46413e878274519d68197c/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:01.780260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.815265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309b5aa-ee51-4156-acf7-c10df93c2c93 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.866058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f838-ee20-4c75-882d-11bd33c43214 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.871420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.872241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.872673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.873075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.873938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.875667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.878522 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:01.886588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 823/1607] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:01.887176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:01.899966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42911-7eda-4300-95d3-87adfeeb4c32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:01.910598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.910598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.910598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.910598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] PATH_INFO: `/v3/projects/1ac32bd147344e28accbed1c643b318f/users/0832de36f3d04557bb401ed9f9b14ba4/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.911020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:01.911020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:01.911020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:01.911020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] PATH_INFO: `/v3/projects/1c387f53134747e4889731f7140a5117/users/5fba6a52dbd643f9bcbe08af7d08ce7b/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:01.920309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac32bd147344e28accbed1c643b318f, user_id=0832de36f3d04557bb401ed9f9b14ba4, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.922063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c387f53134747e4889731f7140a5117, user_id=5fba6a52dbd643f9bcbe08af7d08ce7b, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:01.923092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:01.924771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.011971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 785/1608] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:01 2022] PUT /identity/v3/projects/1ac32bd147344e28accbed1c643b318f/users/0832de36f3d04557bb401ed9f9b14ba4/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:02.012350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 824/1609] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:01 2022] PUT /identity/v3/projects/1c387f53134747e4889731f7140a5117/users/5fba6a52dbd643f9bcbe08af7d08ce7b/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:02.012716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.013297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.021592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:02.083593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bf9b3-64fe-4c76-99b1-db752a720120 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.085140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c811-8e4a-4cd9-8118-814c383f05fc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.089247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c31b-c4ab-4e0b-9887-d7b5e0a6d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.090295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c31b-c4ab-4e0b-9887-d7b5e0a6d078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.090434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.090710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c31b-c4ab-4e0b-9887-d7b5e0a6d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.091050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c31b-c4ab-4e0b-9887-d7b5e0a6d078 admin admin] PATH_INFO: `/v3/projects/813ae067b9f34dd695cfa0311e909c5d/users/e0076dd9130b4bc09c58da3deb4f8517/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.091501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.091786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.092055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] PATH_INFO: `/v3/projects/45b559c305a3465abccba3f5c104d63d/users/56f203a0d36d4ec9a5518df5471991e5/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.093294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5c31b-c4ab-4e0b-9887-d7b5e0a6d078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813ae067b9f34dd695cfa0311e909c5d, user_id=e0076dd9130b4bc09c58da3deb4f8517, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.096844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5c31b-c4ab-4e0b-9887-d7b5e0a6d078 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.117403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 825/1610] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:02 2022] PUT /identity/v3/projects/813ae067b9f34dd695cfa0311e909c5d/users/e0076dd9130b4bc09c58da3deb4f8517/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:02.117403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655192e-0097-4093-9a42-f06721b7ed4b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.117403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655192e-0097-4093-9a42-f06721b7ed4b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.117403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655192e-0097-4093-9a42-f06721b7ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.142838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b559c305a3465abccba3f5c104d63d, user_id=56f203a0d36d4ec9a5518df5471991e5, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.146500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.155167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a655192e-0097-4093-9a42-f06721b7ed4b None None] MFA Rules not processed for user `b0530b2896ea43338ed7b9a02f337061`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.156368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a655192e-0097-4093-9a42-f06721b7ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.224844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 826/1611] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.226291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9d1f-9460-4b4a-a7fc-ebe91339a5e2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.226658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9d1f-9460-4b4a-a7fc-ebe91339a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.227016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9d1f-9460-4b4a-a7fc-ebe91339a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.244688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f8fc9d1f-9460-4b4a-a7fc-ebe91339a5e2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.245962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f8fc9d1f-9460-4b4a-a7fc-ebe91339a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.292410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 786/1612] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:02 2022] PUT /identity/v3/projects/45b559c305a3465abccba3f5c104d63d/users/56f203a0d36d4ec9a5518df5471991e5/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:02.294552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.325606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 827/1613] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.327988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75649a78-0af1-4eb7-96cb-3e4827e51694 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.328328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75649a78-0af1-4eb7-96cb-3e4827e51694 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.328615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75649a78-0af1-4eb7-96cb-3e4827e51694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.350926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-75649a78-0af1-4eb7-96cb-3e4827e51694 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.352330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-75649a78-0af1-4eb7-96cb-3e4827e51694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.363247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c42d23-f99a-4a4c-8580-df89e36b5ad7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.368069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.368964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.369248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.369527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] PATH_INFO: `/v3/projects/d5467180d0b64c5ea5fb331b71e2f00c/users/c7b99b14245d49d68589866ceffeadc3/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.375667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:02.386682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5467180d0b64c5ea5fb331b71e2f00c, user_id=c7b99b14245d49d68589866ceffeadc3, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.389625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.417688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 828/1614] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.419112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736b19b-708b-44d7-8d8a-75d3f2e4c491 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.419407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736b19b-708b-44d7-8d8a-75d3f2e4c491 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.419691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736b19b-708b-44d7-8d8a-75d3f2e4c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.439477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0736b19b-708b-44d7-8d8a-75d3f2e4c491 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.440674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0736b19b-708b-44d7-8d8a-75d3f2e4c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.450413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 829/1615] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.451644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db043e-f122-411d-ba5d-9bce2e05871d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.451941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db043e-f122-411d-ba5d-9bce2e05871d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.453320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db043e-f122-411d-ba5d-9bce2e05871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.477613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-74db043e-f122-411d-ba5d-9bce2e05871d None None] MFA Rules not processed for user `e0076dd9130b4bc09c58da3deb4f8517`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.478724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 787/1616] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:02 2022] PUT /identity/v3/projects/d5467180d0b64c5ea5fb331b71e2f00c/users/c7b99b14245d49d68589866ceffeadc3/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:02.484134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-74db043e-f122-411d-ba5d-9bce2e05871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.484394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.519656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:02.550623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad0625-9dcb-47da-ae7e-e849a1d8e702 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.552894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 830/1617] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.554892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.555259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.555609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.564067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.564742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.565025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.565301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.566827 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.569163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.587616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] MFA Rules not processed for user `56f203a0d36d4ec9a5518df5471991e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.588830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.653524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 831/1618] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.654502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.673072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 788/1619] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:02.673072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.675022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.694176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:02.710496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c335faa-4e1e-4b85-a946-ab405ab2264e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.733242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791a02e-465b-4720-93d6-84f8ed6e2309 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.738920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.739921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.740260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.740583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.761844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51753437-b927-48cf-bafa-71cfdb2ddbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.762730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51753437-b927-48cf-bafa-71cfdb2ddbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.763117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51753437-b927-48cf-bafa-71cfdb2ddbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.763631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51753437-b927-48cf-bafa-71cfdb2ddbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.819892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.820975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.836439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 789/1620] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:02.836439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.836878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51753437-b927-48cf-bafa-71cfdb2ddbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.838406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51753437-b927-48cf-bafa-71cfdb2ddbc8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.844898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408f1d-102a-428c-8172-76655be28427 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.849176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.849738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 832/1621] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:02.849973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.850359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.851392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.851827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.852335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.852519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.864224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.872597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.876244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:02.877636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:02.884712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 790/1622] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:02.885692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.887248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 833/1623] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:02.888060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:02.905124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798daa2-fef3-4580-a23c-ade7ad5ca529 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.910486 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.911383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.911865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.913704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.915581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:02.918618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:02.953570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e01f4-3022-4cee-82e5-14ffdf7df883 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:02.957536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:02.958421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:02.958538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:02.958831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:02.967965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:03.048659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.050180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.061861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 791/1624] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:03.062768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.075453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492842cd-f16e-47e0-84e1-3d95af7d24fd service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.084338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.085280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.085615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.085900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.086726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.091591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.096314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 834/1625] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:02 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:03.097359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.224623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeed92-fd13-4b24-9c4e-1c13df7f957a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.236621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.237317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.237940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.237940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.246625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 792/1626] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:03 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:03.246625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.260152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ef6f-7a32-4d74-a852-43b6a4812f45 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.297552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:03.346565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.348433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.349138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.349769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.352043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.353565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.375641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.377337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.389052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 835/1627] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:03.390327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.401086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef895a7-366a-44c2-b40e-6ed2f115daec service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.407016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.408038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.408572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.409058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.410067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.414360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.429471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 836/1628] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:03.430598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.452480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999c850-8bc5-436c-bfef-3849d20bd4d5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.459320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.460942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.461305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.461657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] PATH_INFO: `/v3/users/04179e46107e46439962cba9192d0d2a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.463257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04179e46107e46439962cba9192d0d2a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.464871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:28:03.464871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: warnings.warn(msg) Jun 20 12:28:03.464871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: Jun 20 12:28:03.466933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.481899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 793/1629] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:03 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:03.486192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.521494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462cdab-00af-4569-9dc5-410647185c7b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.543209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.544175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.544487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.544765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] PATH_INFO: `/v3/projects/30ea359356dd4e9eb69ec07233f0a4fa/users/f7666ee02bad46a19be6236ec9deabce/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.566925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ea359356dd4e9eb69ec07233f0a4fa, user_id=f7666ee02bad46a19be6236ec9deabce, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.572534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.681564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 794/1630] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:03 2022] PUT /identity/v3/projects/30ea359356dd4e9eb69ec07233f0a4fa/users/f7666ee02bad46a19be6236ec9deabce/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:03.687947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.771760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:03.817986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc141e1a-19f6-42cd-bec6-83e53201d850 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.834219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.834890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.835850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.836672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.837247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.839523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04179e46107e46439962cba9192d0d2a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:03.840571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04179e46107e46439962cba9192d0d2a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:03.844351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.872040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 795/1631] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:03.873304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.874260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04179e46107e46439962cba9192d0d2a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:03.875776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:03.893199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04179e46107e46439962cba9192d0d2a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:03.896864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420b317-0f17-4c8e-ac4f-979f8e19ac75 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.903282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.904065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.904433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.904819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.905621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.908070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.923355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 796/1632] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:03.923355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.925842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:03.949101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9900d-7630-4c30-941b-4b0c943846f5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.956215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2782fb7-663e-4367-8393-bc78222545c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.957440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2782fb7-663e-4367-8393-bc78222545c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.957930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2782fb7-663e-4367-8393-bc78222545c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.958438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2782fb7-663e-4367-8393-bc78222545c3 admin admin] PATH_INFO: `/v3/projects/232a2425355a4c109e80919febea5193/users/7bf7cbc86da444109d24ea5c6c7cb6b2/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.977510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2782fb7-663e-4367-8393-bc78222545c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232a2425355a4c109e80919febea5193, user_id=7bf7cbc86da444109d24ea5c6c7cb6b2, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.981623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2782fb7-663e-4367-8393-bc78222545c3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.988821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04179e46107e46439962cba9192d0d2a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:04.001319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 837/1633] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:03 2022] DELETE /identity/v3/users/04179e46107e46439962cba9192d0d2a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:04.002783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:04.105784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020da0c3-0840-4026-978f-f160e968f647 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:04.108111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22071cca-4164-4aaa-86c8-97e049e13644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:04.109094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22071cca-4164-4aaa-86c8-97e049e13644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.109546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22071cca-4164-4aaa-86c8-97e049e13644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.113815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22071cca-4164-4aaa-86c8-97e049e13644 admin admin] PATH_INFO: `/v3/projects/30ea359356dd4e9eb69ec07233f0a4fa/users/f7666ee02bad46a19be6236ec9deabce/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.113815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22071cca-4164-4aaa-86c8-97e049e13644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ea359356dd4e9eb69ec07233f0a4fa, user_id=f7666ee02bad46a19be6236ec9deabce, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:04.116816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22071cca-4164-4aaa-86c8-97e049e13644 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:04.130416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 838/1634] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:04 2022] PUT /identity/v3/projects/30ea359356dd4e9eb69ec07233f0a4fa/users/f7666ee02bad46a19be6236ec9deabce/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:04.143186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.143734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.144096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.155644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 797/1635] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:03 2022] PUT /identity/v3/projects/232a2425355a4c109e80919febea5193/users/7bf7cbc86da444109d24ea5c6c7cb6b2/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:04.157215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.157646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.159372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.326779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:04.326779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:04.327435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] MFA Rules not processed for user `f7666ee02bad46a19be6236ec9deabce`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:04.327435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:04.328116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:04.357619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 839/1636] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:04.359096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:04.380229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282d885-9e65-402d-aff2-70fe28141392 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:04.385892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:04.386631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.386923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.387203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.387942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:04.390074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:04.392379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 798/1637] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:04.393556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:04.395480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:04.406586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 840/1638] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:04.407426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:04.409435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:04.470972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59d95-7e20-4c12-b872-0ff1f83be8f1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:04.475659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:04.476320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.476609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.476947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.487695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96d6a-e657-479a-b0ce-3e1cfc2febe5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:04.493727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:04.501819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:04.501970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e543f5-4042-4528-a4f4-02e97a4342f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:04.501970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e543f5-4042-4528-a4f4-02e97a4342f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.502670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e543f5-4042-4528-a4f4-02e97a4342f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.502806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e543f5-4042-4528-a4f4-02e97a4342f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.511836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 799/1639] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:04.513325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:04.531045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630f447-0201-4b40-8a58-673b6456a3c3 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:04.531177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e543f5-4042-4528-a4f4-02e97a4342f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:04.531177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e543f5-4042-4528-a4f4-02e97a4342f7 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:04.533765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:04.534579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.535082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.535381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] PATH_INFO: `/v3/projects/232a2425355a4c109e80919febea5193/users/7bf7cbc86da444109d24ea5c6c7cb6b2/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.537798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] RBAC: Authorizing `identity:create_grant(project_id=232a2425355a4c109e80919febea5193, user_id=7bf7cbc86da444109d24ea5c6c7cb6b2, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:04.541270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:04.545285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 841/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:04.555739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 800/1641] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:04 2022] PUT /identity/v3/projects/232a2425355a4c109e80919febea5193/users/7bf7cbc86da444109d24ea5c6c7cb6b2/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:04.567125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:04.567445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:04.567726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:04.743789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] MFA Rules not processed for user `7bf7cbc86da444109d24ea5c6c7cb6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:04.745074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:04.877906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 842/1642] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:04.890841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:04.893392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:05.049930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a633e-2fb6-4306-8472-902da8a1567f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:05.058745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:05.059253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:05.059647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:05.060069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:05.076806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:05.080564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:05.111037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 801/1643] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:05.203989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:05.205853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:05.258116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:05.317625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec34ed-9253-4333-a490-67a47957b5e3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:05.325013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:05.633164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:05.633164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:05.633164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] PATH_INFO: `/v3/projects/4ccc87c53b7b4e279d8e8c73a914b1f2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:05.633164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccc87c53b7b4e279d8e8c73a914b1f2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:05.633164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:05.640161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccc87c53b7b4e279d8e8c73a914b1f2', 'request_id': 'req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:05.805937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccc87c53b7b4e279d8e8c73a914b1f2', 'request_id': 'req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:05.813338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccc87c53b7b4e279d8e8c73a914b1f2', 'request_id': 'req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:05.824364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] The token cache is being invalidate because project 4ccc87c53b7b4e279d8e8c73a914b1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:05.825333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:05.826014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:05.827638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 843/1644] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:05 2022] DELETE /identity/v3/projects/4ccc87c53b7b4e279d8e8c73a914b1f2 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:05.831580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:05.842696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0965f3-e100-4b05-833c-04e6c7a36d47 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:05.961456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:05.962390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:05.962675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:05.962955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] PATH_INFO: `/v3/users/e0076dd9130b4bc09c58da3deb4f8517` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:05.965104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0076dd9130b4bc09c58da3deb4f8517)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:05.970621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:05.972079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:05.974204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:06.005027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e840-92e2-4c8b-9bd0-beb8bf57eecb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:06.027018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:06.028023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:06.028413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:06.028702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] PATH_INFO: `/v3/users/b0530b2896ea43338ed7b9a02f337061` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:06.033123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0530b2896ea43338ed7b9a02f337061)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:06.040677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:06.264955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0076dd9130b4bc09c58da3deb4f8517'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.281434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0076dd9130b4bc09c58da3deb4f8517'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.320513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0530b2896ea43338ed7b9a02f337061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.321398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0530b2896ea43338ed7b9a02f337061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.345632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0530b2896ea43338ed7b9a02f337061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.355753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0530b2896ea43338ed7b9a02f337061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.389218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0076dd9130b4bc09c58da3deb4f8517'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.399081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0076dd9130b4bc09c58da3deb4f8517'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.399870 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bdfabbb-1f47-4b67-bcb2-a0a6b3a742d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0076dd9130b4bc09c58da3deb4f8517'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.411881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 802/1645] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:05 2022] DELETE /identity/v3/users/e0076dd9130b4bc09c58da3deb4f8517 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:06.416830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:06.417168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:06.417449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:06.501568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] MFA Rules not processed for user `5fba6a52dbd643f9bcbe08af7d08ce7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:06.503560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:06.513515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b766a0ed-dd32-4035-8dbc-df7972bd9938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0530b2896ea43338ed7b9a02f337061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:06.526437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 844/1646] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:05 2022] DELETE /identity/v3/users/b0530b2896ea43338ed7b9a02f337061 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:06.532451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:06.532740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:06.533033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:06.589921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:06.591044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:06.635508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:06.664771 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 803/1647] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:06.666587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:06.667639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:06.757862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 845/1648] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:06.759300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:06.761633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:06.778315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dbfe4-12e1-461d-a1a5-dce45acc7664 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:06.784518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:06.785694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:06.786196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:06.786938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] PATH_INFO: `/v3/users/56f203a0d36d4ec9a5518df5471991e5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:06.788650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f203a0d36d4ec9a5518df5471991e5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:06.790919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:06.807217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:06.827514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4a80a-b914-4e15-93e7-844085b94996 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:06.833542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:06.836697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:06.836697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:06.836697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:06.837222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:06.839740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:06.987613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 804/1649] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:06 2022] POST /identity/v3/projects => generated 405 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:06.989427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:06.992223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:07.003876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f203a0d36d4ec9a5518df5471991e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.006756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f203a0d36d4ec9a5518df5471991e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.049270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f203a0d36d4ec9a5518df5471991e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.067013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f203a0d36d4ec9a5518df5471991e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.079887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052404df-9920-40dd-bd25-60a03640c57b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:07.084217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:07.085096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.085538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.085970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.088153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:07.118911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:07.172164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f203a0d36d4ec9a5518df5471991e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.180324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 846/1650] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:06 2022] DELETE /identity/v3/users/56f203a0d36d4ec9a5518df5471991e5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:07.180489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:07.183894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:07.213468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:07.218194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4d088-3594-4423-a5ea-d4cb2daaab81 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:07.250261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 805/1651] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:07.256483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.256822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.257637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.326310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:07.328767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:07.406028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd607-f5b2-4ddc-995a-bb54a4a0e386 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:07.417846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:07.418625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.418918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.419202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.419899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:07.421868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:07.489959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 806/1652] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:07.491273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:07.494775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:07.508465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf4c68-b6f6-4274-bc5a-25702ed415ae None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:07.514922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:07.516222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.516802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.517189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] PATH_INFO: `/v3/projects/813ae067b9f34dd695cfa0311e909c5d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.518589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=813ae067b9f34dd695cfa0311e909c5d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:07.519768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: WARNING py.warnings [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:28:07.519768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: warnings.warn(msg) Jun 20 12:28:07.519768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: Jun 20 12:28:07.521701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:07.558646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 847/1653] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:07 2022] POST /identity/v3/users => generated 309 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:07.559636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:07.571727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:07.648843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b0ba-bdff-40ee-9a1c-dbb094c7a153 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:07.653121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:07.654027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.654401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.654748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.670600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:07.672984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:07.686552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 848/1654] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:07.687486 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:07.700470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed166090-d402-48f0-9ba8-058e2228f330 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:07.712894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813ae067b9f34dd695cfa0311e909c5d', 'request_id': 'req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.745619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813ae067b9f34dd695cfa0311e909c5d', 'request_id': 'req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.762863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813ae067b9f34dd695cfa0311e909c5d', 'request_id': 'req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.776698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:07.777607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.780395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.780395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.780395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:07.781447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:07.796989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 849/1655] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:07.798561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:07.815777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e135eb3-2929-4f5a-9468-b3a7057c9a10 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:07.830538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:07.831865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.832290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.832669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] PATH_INFO: `/v3/projects/dd5e68a66701433d8333cf866b6d7693/users/c8bb30f6c8ab46d880bef95f3dcaea3d/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:07.871611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5e68a66701433d8333cf866b6d7693, user_id=c8bb30f6c8ab46d880bef95f3dcaea3d, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:07.877835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:07.956196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] The token cache is being invalidate because project 813ae067b9f34dd695cfa0311e909c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:07.956678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.958346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4fb6c87a-2606-4f13-8666-6bb2f35a77cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:07.961837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 807/1656] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:07 2022] DELETE /identity/v3/projects/813ae067b9f34dd695cfa0311e909c5d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:07.966567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb529fc-d12b-4aa9-b1ef-f3c857a2113e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:07.966702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb529fc-d12b-4aa9-b1ef-f3c857a2113e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:07.966923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb529fc-d12b-4aa9-b1ef-f3c857a2113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.012565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6eb529fc-d12b-4aa9-b1ef-f3c857a2113e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:08.013816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6eb529fc-d12b-4aa9-b1ef-f3c857a2113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:08.035885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 850/1657] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:07 2022] PUT /identity/v3/projects/dd5e68a66701433d8333cf866b6d7693/users/c8bb30f6c8ab46d880bef95f3dcaea3d/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:08.037245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:08.039850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 808/1658] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:08.051361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.051656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.051957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.053829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:08.093853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:08.095208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:08.254540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432f21-059b-4730-b03e-0fa39603ff0e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:08.269776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:08.270718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.271101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.271475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.272149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 809/1659] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:08.276545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:08.277321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:08.283788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:08.292406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b073ab-8610-4513-b019-de14ca1d3c15 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:08.308747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 851/1660] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:08.309363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:08.310174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.310465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.310608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:08.310759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.313430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:08.313775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:08.315494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:08.336574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179177b-2452-40b9-a9c1-1466022d1edf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:08.351393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:08.356590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.356590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.356776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 810/1661] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:28:08.356856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] PATH_INFO: `/v3/projects/dd5e68a66701433d8333cf866b6d7693/users/c8bb30f6c8ab46d880bef95f3dcaea3d/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.357288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:08.358041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5e68a66701433d8333cf866b6d7693, user_id=c8bb30f6c8ab46d880bef95f3dcaea3d, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:08.362293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:08.388940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 852/1662] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:08 2022] PUT /identity/v3/projects/dd5e68a66701433d8333cf866b6d7693/users/c8bb30f6c8ab46d880bef95f3dcaea3d/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:08.390286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09c1d4-78c8-4930-88b9-0f94415816d6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:08.549140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:08.549828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.550142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.550423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.551234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:08.556881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:08.683292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 811/1663] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:08 2022] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:08.691091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:08.708988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afccc2-9831-4892-9e2b-7fa211752193 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:08.787518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:08.787759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.788090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.789579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.790363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:08.797037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:08.894391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:08.936870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 853/1664] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:08 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:08.937388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:08.948376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0cd4-1242-4f4d-a8cd-d03f4e121a24 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:08.953250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:08.953920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:08.954719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:08.955004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:08.955742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:08.957439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:08.980929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 812/1665] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:08.986599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:09.001659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec422-bbf6-4514-b866-459100701b27 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:09.023022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721fe71-06d8-417a-b68c-70adeddd5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:09.024236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721fe71-06d8-417a-b68c-70adeddd5dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.024537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721fe71-06d8-417a-b68c-70adeddd5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.024976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721fe71-06d8-417a-b68c-70adeddd5dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.026068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721fe71-06d8-417a-b68c-70adeddd5dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:09.032715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721fe71-06d8-417a-b68c-70adeddd5dfc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:09.034321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:09.077086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:09.080590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 854/1666] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:09.092196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1b31-7007-4574-bc91-7137c173bb9a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:09.101224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:09.105525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.118921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.119615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] PATH_INFO: `/v3/projects/98133ad60d2a448ca1afc5c7d9614e95/users/5dab7aa1f682412689e82da1e0d91a5b/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.141696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98133ad60d2a448ca1afc5c7d9614e95, user_id=5dab7aa1f682412689e82da1e0d91a5b, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:09.146829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:09.248881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 813/1667] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:09 2022] PUT /identity/v3/projects/98133ad60d2a448ca1afc5c7d9614e95/users/5dab7aa1f682412689e82da1e0d91a5b/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:09.260508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.261003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.261537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.328291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] MFA Rules not processed for user `5dab7aa1f682412689e82da1e0d91a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:09.331539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:09.449899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 855/1668] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:09.454210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:09.647288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46b37-f5ce-4b3b-a241-7e08bedd072d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:09.654840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:09.655525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.655809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.656099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.656806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:09.658981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:09.696053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:09.698352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:09.747265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db220-59d4-41de-9a28-dab0866b5c51 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:09.769637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:09.770562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.770851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.771128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] PATH_INFO: `/v3/projects/cef0929fac2749cbaf66b53266efd434` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.774487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef0929fac2749cbaf66b53266efd434)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:09.776413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:09.802532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 814/1669] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:09 2022] POST /identity/v3/projects => generated 381 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:09.803642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:09.938901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a102121-f1cb-407a-9eca-17ae8bbaf93e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:09.941116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:09.941928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.942308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.942680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.946384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:09.948589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:10.018696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef0929fac2749cbaf66b53266efd434', 'request_id': 'req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.089814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 815/1670] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:09 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:10.091066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:10.094819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:10.108605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef0929fac2749cbaf66b53266efd434', 'request_id': 'req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.117257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:10.123712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef0929fac2749cbaf66b53266efd434', 'request_id': 'req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.138083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9ea0-ceb5-45e8-be30-2d6b93229090 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:10.156636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] The token cache is being invalidate because project cef0929fac2749cbaf66b53266efd434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:10.157505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.165364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.168665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 856/1671] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:09 2022] DELETE /identity/v3/projects/cef0929fac2749cbaf66b53266efd434 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:10.169525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:10.174936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:10.340100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:10.342654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:10.344890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:10.346525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] PATH_INFO: `/v3/projects/45b559c305a3465abccba3f5c104d63d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:10.348113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b559c305a3465abccba3f5c104d63d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:10.355054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:10.369052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0325bc9-8e09-4772-85ae-2c21cd61a9c3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:10.381221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:10.382512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:10.383030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:10.383150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:10.383817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:10.400865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:10.438639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 857/1672] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:10.445894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:10.452672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:10.491585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652775-1359-4c28-80eb-aaf367c440e7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:10.511574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:10.512630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:10.512928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:10.513214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] PATH_INFO: `/v3/users/f7666ee02bad46a19be6236ec9deabce` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:10.526579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7666ee02bad46a19be6236ec9deabce)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:10.528594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:10.589387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b559c305a3465abccba3f5c104d63d', 'request_id': 'req-abce9897-ac03-4007-8d9c-0be7aaa60333'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.607483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b559c305a3465abccba3f5c104d63d', 'request_id': 'req-abce9897-ac03-4007-8d9c-0be7aaa60333'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.619760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b559c305a3465abccba3f5c104d63d', 'request_id': 'req-abce9897-ac03-4007-8d9c-0be7aaa60333'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.705648 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] The token cache is being invalidate because project 45b559c305a3465abccba3f5c104d63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:10.705951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.707602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.716069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 816/1673] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:10 2022] DELETE /identity/v3/projects/45b559c305a3465abccba3f5c104d63d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:10.719658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:10.729724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:10.842820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7666ee02bad46a19be6236ec9deabce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.851758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7666ee02bad46a19be6236ec9deabce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.886728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7666ee02bad46a19be6236ec9deabce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.908207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7666ee02bad46a19be6236ec9deabce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:10.939172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce9897-ac03-4007-8d9c-0be7aaa60333 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:10.959178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:10.961315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:10.961599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:10.961876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] PATH_INFO: `/v3/projects/0214965192b74612b4d29b72f53ead55/users/208b48c1ebad43c9941ec6c77b57b414/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:11.011415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7666ee02bad46a19be6236ec9deabce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:11.016638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0214965192b74612b4d29b72f53ead55, user_id=208b48c1ebad43c9941ec6c77b57b414, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:11.020733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:11.028863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 858/1674] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:10 2022] DELETE /identity/v3/users/f7666ee02bad46a19be6236ec9deabce => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:11.028863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:11.029886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:11.097488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:11.130175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 817/1675] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:10 2022] PUT /identity/v3/projects/0214965192b74612b4d29b72f53ead55/users/208b48c1ebad43c9941ec6c77b57b414/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:11.134300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:11.145537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:11.220232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe8b0-210b-4787-8a67-99d271eb2e8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:11.328342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c992e0-eded-4bfc-9038-852a976b667b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:11.341145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:11.341145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:11.341145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:11.341145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:11.341792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:11.344153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:11.353975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:11.357103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:11.357388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:11.357665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] PATH_INFO: `/v3/users/7bf7cbc86da444109d24ea5c6c7cb6b2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:11.364207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 818/1676] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:11.364508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf7cbc86da444109d24ea5c6c7cb6b2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:11.365842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:11.367808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:11.377923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049043-f9bc-4631-8a5b-be24d92b0b70 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:11.387539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe55a-7ef5-472a-a4f6-b276b5065137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:11.388475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe55a-7ef5-472a-a4f6-b276b5065137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:11.388761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe55a-7ef5-472a-a4f6-b276b5065137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:11.389043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe55a-7ef5-472a-a4f6-b276b5065137 admin admin] PATH_INFO: `/v3/projects/0214965192b74612b4d29b72f53ead55/users/208b48c1ebad43c9941ec6c77b57b414/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:11.395000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe55a-7ef5-472a-a4f6-b276b5065137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0214965192b74612b4d29b72f53ead55, user_id=208b48c1ebad43c9941ec6c77b57b414, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:11.398323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe55a-7ef5-472a-a4f6-b276b5065137 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:11.438042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 819/1677] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:11 2022] PUT /identity/v3/projects/0214965192b74612b4d29b72f53ead55/users/208b48c1ebad43c9941ec6c77b57b414/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:11.454976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:11.455312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:11.455658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:11.503484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] MFA Rules not processed for user `208b48c1ebad43c9941ec6c77b57b414`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:11.504712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:11.644298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf7cbc86da444109d24ea5c6c7cb6b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:11.647101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf7cbc86da444109d24ea5c6c7cb6b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:11.679557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf7cbc86da444109d24ea5c6c7cb6b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:11.685723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 820/1678] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:11.699164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf7cbc86da444109d24ea5c6c7cb6b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:11.699749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:11.700995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:11.783562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-84b9f9e2-c86a-466c-af9b-bfeccd099c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf7cbc86da444109d24ea5c6c7cb6b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:11.795903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 859/1679] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:11 2022] DELETE /identity/v3/users/7bf7cbc86da444109d24ea5c6c7cb6b2 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:11.815422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6963c-d537-4603-88ed-2c0c27616bc6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:11.956137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:11.956137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:11.958361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:11.958707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:12.024449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:12.025247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:12.025612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:12.097862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] MFA Rules not processed for user `c8bb30f6c8ab46d880bef95f3dcaea3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:12.100976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:12.125727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:12.127501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:12.158418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 821/1680] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:12.177649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:12.262164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 860/1681] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:12.323413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:12.325327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:12.446248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:12.464783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850adbd6-c4b2-4186-ad6c-f064e8b53c94 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:12.469654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f3ea2-738c-4033-80a0-f5e49c07e42d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:12.473021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:12.474414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:12.474949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:12.475672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] PATH_INFO: `/v3/projects/30ea359356dd4e9eb69ec07233f0a4fa` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:12.477247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ea359356dd4e9eb69ec07233f0a4fa)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:12.478149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:12.479217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:12.479711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:12.481166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:12.483906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:12.489789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:12.489789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:12.670579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ea359356dd4e9eb69ec07233f0a4fa', 'request_id': 'req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:12.671250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:12.672754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc222e63-a5ed-4a61-920e-6349296d7287 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:12.685040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ea359356dd4e9eb69ec07233f0a4fa', 'request_id': 'req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:12.692807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ea359356dd4e9eb69ec07233f0a4fa', 'request_id': 'req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:12.702272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 861/1682] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:12.892431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] The token cache is being invalidate because project 30ea359356dd4e9eb69ec07233f0a4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:12.893432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:12.893804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0137bcec-ad1c-4bda-ac35-a4740ce1c7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:12.896141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 822/1683] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:12 2022] DELETE /identity/v3/projects/30ea359356dd4e9eb69ec07233f0a4fa => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:12.901426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad484-804e-4d07-8342-9a73a3f5e646 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:12.901649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad484-804e-4d07-8342-9a73a3f5e646 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:12.901936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad484-804e-4d07-8342-9a73a3f5e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:12.937575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a8ad484-804e-4d07-8342-9a73a3f5e646 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:12.938884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a8ad484-804e-4d07-8342-9a73a3f5e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:13.072192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 862/1684] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:13.078313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d323-6d9a-4986-9ba8-00c31f48cb99 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.078313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d323-6d9a-4986-9ba8-00c31f48cb99 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.078313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d323-6d9a-4986-9ba8-00c31f48cb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.087514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.087859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.088151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.133032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2593d323-6d9a-4986-9ba8-00c31f48cb99 None None] MFA Rules not processed for user `9ea06252769148759586242b0b5f562c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:13.136211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:13.137794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:13.137971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2593d323-6d9a-4986-9ba8-00c31f48cb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:13.154730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 863/1685] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:13.175374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:13.203114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a9c5-0d63-4dbd-af30-dcbaa1132079 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:13.206180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:13.208202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.208761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.209257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.210908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:13.211450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:13.213306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:13.234226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 864/1686] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:28:13.238374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:13.255750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f868-0eb6-4210-b0df-bf39e5daada1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:13.263120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:13.265304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.266058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.267004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.269914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:13.276605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:13.316465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 823/1687] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:13.349066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42b1c-580c-4baa-8abb-fe1c310f0ea9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.349362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42b1c-580c-4baa-8abb-fe1c310f0ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.349702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42b1c-580c-4baa-8abb-fe1c310f0ea9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.351646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 824/1688] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jun 20 12:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:13.369591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.370137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.370432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.426792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:13.428786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:13.461107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 865/1689] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:13 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:13.465640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:13.563289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 825/1690] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jun 20 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:13.564533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:13.583091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:13.595793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdddc7-c590-434e-b8ec-c4ba7e7ab39f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:13.733397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412b8fa-83eb-478d-ab08-fe25bc784143 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:13.745961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:13.749853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.750185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.750475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.754305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:13.759511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:13.764040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:13.764040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.764040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.764040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.898952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 866/1691] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:13 2022] POST /identity/v3/users => generated 284 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:13.900083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:13.915749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3d12-acb0-485e-96de-f861ad3202d1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:13.930367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:13.930968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:13.931519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:13.931798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:13.932536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:13.936175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:13.959303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 867/1692] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:13.966971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:13.969488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:13.974139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:14.001892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e6cf-621f-4044-be70-f45c66c6f726 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:14.019649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 826/1693] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:14.041724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:14.045021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.048429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.049040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.050591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:14.055088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:14.055248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:14.056810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:14.085404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8e95-038b-4db2-b7fe-7d56242b1992 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:14.094802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 868/1694] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:14.095076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:14.096163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.096390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.096677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] PATH_INFO: `/v3/projects/232a2425355a4c109e80919febea5193` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.096787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:14.099304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] RBAC: Authorizing `identity:delete_project(project_id=232a2425355a4c109e80919febea5193)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:14.107951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:14.117929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dab3bb-b46a-43e3-9a20-99531ee4f3c7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:14.131468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e6d5f-2ef4-47c8-9fe4-6f1c7d243702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:14.133435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e6d5f-2ef4-47c8-9fe4-6f1c7d243702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.133872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e6d5f-2ef4-47c8-9fe4-6f1c7d243702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.134327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e6d5f-2ef4-47c8-9fe4-6f1c7d243702 admin admin] PATH_INFO: `/v3/projects/f8353cd455854c7397eeeb90c2159a2f/users/d9ee4bede7b643be81b25a5d06ee4f9a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.172038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e6d5f-2ef4-47c8-9fe4-6f1c7d243702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8353cd455854c7397eeeb90c2159a2f, user_id=d9ee4bede7b643be81b25a5d06ee4f9a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:14.174963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e6d5f-2ef4-47c8-9fe4-6f1c7d243702 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:14.303321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 869/1695] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:14 2022] PUT /identity/v3/projects/f8353cd455854c7397eeeb90c2159a2f/users/d9ee4bede7b643be81b25a5d06ee4f9a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:14.320122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.320620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.321051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.362193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] MFA Rules not processed for user `d9ee4bede7b643be81b25a5d06ee4f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:14.363868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:14.374855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232a2425355a4c109e80919febea5193', 'request_id': 'req-62426462-f020-44b3-856b-634dc6a0996d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:14.389844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232a2425355a4c109e80919febea5193', 'request_id': 'req-62426462-f020-44b3-856b-634dc6a0996d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:14.411039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232a2425355a4c109e80919febea5193', 'request_id': 'req-62426462-f020-44b3-856b-634dc6a0996d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:14.451252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 870/1696] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:14.456857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:14.528878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] The token cache is being invalidate because project 232a2425355a4c109e80919febea5193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:14.529345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:14.530430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62426462-f020-44b3-856b-634dc6a0996d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:14.533126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 827/1697] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:14 2022] DELETE /identity/v3/projects/232a2425355a4c109e80919febea5193 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:14.539265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd872-10de-4665-8d6d-05dc40e150fb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.540374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd872-10de-4665-8d6d-05dc40e150fb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.540713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd872-10de-4665-8d6d-05dc40e150fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.592834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dc0fd872-10de-4665-8d6d-05dc40e150fb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:14.594148 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dc0fd872-10de-4665-8d6d-05dc40e150fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:14.625288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd074f-2a83-4d38-9ec3-762b7d342977 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:14.635817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:14.636716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.637115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.637505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.638762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:14.640849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:14.730742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 828/1698] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:14.741805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.742109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.742399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.750814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:14.758917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 871/1699] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:14 2022] POST /identity/v3/projects => generated 367 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:14.768996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:14.777055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:14.778865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:14.779506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:14.951652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 829/1700] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:14.958359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:14.958488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c68c9-281f-4084-90bc-f9558a81bd48 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:14.969842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92ab4-0669-40f4-a538-9c9166fd22cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:14.970569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92ab4-0669-40f4-a538-9c9166fd22cc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.970858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92ab4-0669-40f4-a538-9c9166fd22cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.971137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92ab4-0669-40f4-a538-9c9166fd22cc admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.971992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92ab4-0669-40f4-a538-9c9166fd22cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:14.974054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92ab4-0669-40f4-a538-9c9166fd22cc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:14.979157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4788f8f-63f9-404c-ba20-9abffdba4715 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:14.991197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:14.992629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:14.995526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:14.996469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:14.997356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:14.999591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.005336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.037215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 830/1701] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:15.042068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.063452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e7169-8c69-425e-8b6b-10b725490ee9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.078949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.081187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.081187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.081187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.081723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.088480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.122570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 872/1702] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:14 2022] POST /identity/v3/users => generated 290 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:15.124212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1c32-0393-4030-84c5-e206ebce12a0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.127043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1c32-0393-4030-84c5-e206ebce12a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.127043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1c32-0393-4030-84c5-e206ebce12a0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.132582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 873/1703] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:28:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:15.138727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1c32-0393-4030-84c5-e206ebce12a0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.204148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1c32-0393-4030-84c5-e206ebce12a0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.214287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61d2bd-565c-4b3f-a1d3-e9b07cc12a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.215032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d2bd-565c-4b3f-a1d3-e9b07cc12a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.215324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d2bd-565c-4b3f-a1d3-e9b07cc12a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.215660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d2bd-565c-4b3f-a1d3-e9b07cc12a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.216401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61d2bd-565c-4b3f-a1d3-e9b07cc12a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.224683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61d2bd-565c-4b3f-a1d3-e9b07cc12a79 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.252543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 874/1704] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:15.256005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 831/1705] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:15.264972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.265107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.265368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.265870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.352185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:15.355634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:15.427990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981f18-e412-4b84-9342-9a3b0a03298d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.443954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881efba-5c10-459b-bdd1-985843c18d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.445000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881efba-5c10-459b-bdd1-985843c18d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.445466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881efba-5c10-459b-bdd1-985843c18d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.445858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881efba-5c10-459b-bdd1-985843c18d52 admin admin] PATH_INFO: `/v3/projects/b8b74878e30146ba864acfd11723a7e2/users/b393a3d34038463195ad622bbdf06e97/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.484646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881efba-5c10-459b-bdd1-985843c18d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b74878e30146ba864acfd11723a7e2, user_id=b393a3d34038463195ad622bbdf06e97, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.494698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881efba-5c10-459b-bdd1-985843c18d52 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.530773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 875/1706] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:15.531694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.557799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a3b2-2c14-49a3-ba63-c5fef2911169 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.575382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bf27f-2247-4016-8566-fff2a0e120c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.579261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bf27f-2247-4016-8566-fff2a0e120c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.579261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bf27f-2247-4016-8566-fff2a0e120c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.579261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bf27f-2247-4016-8566-fff2a0e120c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.579261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bf27f-2247-4016-8566-fff2a0e120c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.579593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bf27f-2247-4016-8566-fff2a0e120c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.615011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 832/1707] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:15 2022] PUT /identity/v3/projects/b8b74878e30146ba864acfd11723a7e2/users/b393a3d34038463195ad622bbdf06e97/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:15.615011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f87a8-5e8d-450c-80ad-94219d856554 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.615011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f87a8-5e8d-450c-80ad-94219d856554 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.615011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f87a8-5e8d-450c-80ad-94219d856554 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.616707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 833/1708] 10.222.0.70 () {54 vars in 960 bytes} [Mon Jun 20 12:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:15.619061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f87a8-5e8d-450c-80ad-94219d856554 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.727142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 876/1709] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:15 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:15.728833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.731463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.736425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.761099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:15.772115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f87a8-5e8d-450c-80ad-94219d856554 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.786325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.787200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.787601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.788017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.789747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.790912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:15.795335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.796880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:15.822433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 834/1710] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:15.822433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.850454 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437ce68-67c4-4d58-ba8b-4b0c0d544f3c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.868178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.869060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.869457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.869845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.870820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.872647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.903002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 835/1711] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:15.903002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.924152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00f0c-c324-43e2-b2c5-b1e1f80670c5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.940034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:15.941157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:15.941630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:15.942030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] PATH_INFO: `/v3/projects/b8b74878e30146ba864acfd11723a7e2/users/b393a3d34038463195ad622bbdf06e97/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:15.947866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b74878e30146ba864acfd11723a7e2, user_id=b393a3d34038463195ad622bbdf06e97, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:15.950744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:15.955015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 877/1712] 10.222.0.70 () {58 vars in 1057 bytes} [Mon Jun 20 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:15.958497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:15.970867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da7f42-9490-46fa-9b79-6ae0a6553f69 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:15.993045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 836/1713] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:15 2022] PUT /identity/v3/projects/b8b74878e30146ba864acfd11723a7e2/users/b393a3d34038463195ad622bbdf06e97/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:15.993045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:16.084614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109d545-056a-4adf-805c-b9c01da15aa9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:16.084614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be152f0-550d-44e1-9d3c-94f1d24ba558 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:16.084614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be152f0-550d-44e1-9d3c-94f1d24ba558 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.084614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be152f0-550d-44e1-9d3c-94f1d24ba558 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.085607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be152f0-550d-44e1-9d3c-94f1d24ba558 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.093396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be152f0-550d-44e1-9d3c-94f1d24ba558 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:16.096359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be152f0-550d-44e1-9d3c-94f1d24ba558 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:16.109549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 837/1714] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:16.114189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.114189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.114189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.149398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] MFA Rules not processed for user `b393a3d34038463195ad622bbdf06e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:16.151035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:16.153732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:16.156031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.158670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.158670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.160314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:16.165800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:16.215945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 878/1715] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:16.220098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:16.252154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 838/1716] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:16.260685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8546f6-169c-4909-9968-3c163977f4f7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:16.264706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:16.266788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:16.277774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:16.278764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.279064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.279351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] PATH_INFO: `/v3/projects/26f10400882f47da95c17a3eb4d6cb2f/users/3ac011985b484073af103fab81877b5e/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.329751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f10400882f47da95c17a3eb4d6cb2f, user_id=3ac011985b484073af103fab81877b5e, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:16.332569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:16.350937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd89364-56ed-4232-8093-a2a88ba54ede None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:16.355347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eaac-ed9e-48c1-9d12-8964f795c110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:16.356387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eaac-ed9e-48c1-9d12-8964f795c110 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.356706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eaac-ed9e-48c1-9d12-8964f795c110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.357115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eaac-ed9e-48c1-9d12-8964f795c110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.372544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145eaac-ed9e-48c1-9d12-8964f795c110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:16.374222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145eaac-ed9e-48c1-9d12-8964f795c110 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:16.398650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 839/1717] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:16.423741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 879/1718] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:16 2022] PUT /identity/v3/projects/26f10400882f47da95c17a3eb4d6cb2f/users/3ac011985b484073af103fab81877b5e/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:16.439169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.439688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.440127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.530109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] MFA Rules not processed for user `3ac011985b484073af103fab81877b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:16.539754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:16.690714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 840/1719] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:16.695153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:16.876968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a406-07d4-4b7f-95cf-e4cb02e9e521 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:16.887823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:16.889028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:16.889028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:16.889202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:16.892281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:16.897939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:17.092659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 880/1720] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:16 2022] POST /identity/v3/projects => generated 377 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:17.096457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:17.115360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc26058-b7fa-4cc0-b301-afdcafedbab5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:17.243970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:17.244830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:17.244996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:17.245279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:17.245981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:17.247958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:17.351156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 841/1721] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:17 2022] POST /identity/v3/users => generated 295 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:17.355539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:17.367428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:17.374596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6641-2065-403b-b1a8-a958a16e72d9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:17.387975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b16d0-de80-47e6-9c1c-86ee1b737dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:17.388556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b16d0-de80-47e6-9c1c-86ee1b737dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:17.388991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b16d0-de80-47e6-9c1c-86ee1b737dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:17.389186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b16d0-de80-47e6-9c1c-86ee1b737dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:17.390020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b16d0-de80-47e6-9c1c-86ee1b737dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:17.394904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b16d0-de80-47e6-9c1c-86ee1b737dd9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:17.418291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 881/1722] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:17.429701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:17.447088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:17.457319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a0ff0-120e-4c9e-aaff-dcc9cbc50622 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:17.480193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:17.485612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:17.485902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:17.486207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] PATH_INFO: `/v3/projects/55ad65ea06c5493b8edaa375b6771b6a/users/4613267954b14d38adf8546476ddb8a7/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:17.540636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ad65ea06c5493b8edaa375b6771b6a, user_id=4613267954b14d38adf8546476ddb8a7, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:17.540636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:17.680152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3ad2-bfa1-4c95-bd58-b22c35ee0cad None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:17.680622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3ad2-bfa1-4c95-bd58-b22c35ee0cad None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:17.680622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3ad2-bfa1-4c95-bd58-b22c35ee0cad None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:17.682721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 882/1723] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:17.705422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:17.705769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:17.706078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:17.714193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 842/1724] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:17 2022] PUT /identity/v3/projects/55ad65ea06c5493b8edaa375b6771b6a/users/4613267954b14d38adf8546476ddb8a7/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:17.717600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:17.734180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] MFA Rules not processed for user `c51168ff1c1f42e781051ace1af97dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:17.735874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:17.916733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f66aa-6c95-4b7c-adb4-9f831e48973d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:17.930018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:17.939108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:17.939747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:17.943527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:17.943527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:17.946438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:17.979259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 843/1725] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:17.979259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:17.983593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:18.027868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 883/1726] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:28:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:18.034631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:18.044723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71beea-9c81-45f6-8cac-70b471fb8a46 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:18.065140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:18.066802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:18.068283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:18.070285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] PATH_INFO: `/v3/users/5fba6a52dbd643f9bcbe08af7d08ce7b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:18.072725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fba6a52dbd643f9bcbe08af7d08ce7b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:18.081273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:18.087898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816f09f-a01e-4b03-9cc9-116b62a80f49 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:18.102730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:18.103705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:18.103986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:18.104261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] PATH_INFO: `/v3/projects/55ad65ea06c5493b8edaa375b6771b6a/users/4613267954b14d38adf8546476ddb8a7/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:18.119497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ad65ea06c5493b8edaa375b6771b6a, user_id=4613267954b14d38adf8546476ddb8a7, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:18.125822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:18.178269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 884/1727] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:18 2022] PUT /identity/v3/projects/55ad65ea06c5493b8edaa375b6771b6a/users/4613267954b14d38adf8546476ddb8a7/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:18.182836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:18.388018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11a81-860d-4508-b705-724aae3989ef admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:18.396688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36f56-99ab-4636-964f-7910a56ba554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:18.398805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36f56-99ab-4636-964f-7910a56ba554 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:18.402751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36f56-99ab-4636-964f-7910a56ba554 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:18.402751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36f56-99ab-4636-964f-7910a56ba554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:18.410585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36f56-99ab-4636-964f-7910a56ba554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:18.412656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36f56-99ab-4636-964f-7910a56ba554 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:18.428378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 885/1728] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:18.430724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:18.431531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:18.432034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:18.471826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] MFA Rules not processed for user `4613267954b14d38adf8546476ddb8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:18.473436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:18.568050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 886/1729] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:18.582505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:18.655590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80664d-c4ad-4ca6-8a91-f4104dc38966 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:18.661276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f335f8-776b-44af-a7c5-6138f251a45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:18.662258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f335f8-776b-44af-a7c5-6138f251a45a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:18.662875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f335f8-776b-44af-a7c5-6138f251a45a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:18.663396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f335f8-776b-44af-a7c5-6138f251a45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:18.748416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f335f8-776b-44af-a7c5-6138f251a45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:18.750704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f335f8-776b-44af-a7c5-6138f251a45a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:18.766617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 887/1730] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:18.800847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fba6a52dbd643f9bcbe08af7d08ce7b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:18.831023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fba6a52dbd643f9bcbe08af7d08ce7b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:18.914312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fba6a52dbd643f9bcbe08af7d08ce7b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:18.927029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fba6a52dbd643f9bcbe08af7d08ce7b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:18.927833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a446ad87-1961-42a9-af30-b759dbc9435a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fba6a52dbd643f9bcbe08af7d08ce7b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:18.957628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 844/1731] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:17 2022] DELETE /identity/v3/users/5fba6a52dbd643f9bcbe08af7d08ce7b => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:19.661741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a403-f2d9-4d7c-8180-9f2116d7dd5b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:19.662055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a403-f2d9-4d7c-8180-9f2116d7dd5b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:19.662479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a403-f2d9-4d7c-8180-9f2116d7dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:19.795294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8237a403-f2d9-4d7c-8180-9f2116d7dd5b None None] MFA Rules not processed for user `0832de36f3d04557bb401ed9f9b14ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:19.802751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8237a403-f2d9-4d7c-8180-9f2116d7dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:19.994090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 888/1732] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:19.999756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ee9f-44cd-4a78-89cb-614a4d1bd9cd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:20.000360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ee9f-44cd-4a78-89cb-614a4d1bd9cd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:20.000360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ee9f-44cd-4a78-89cb-614a4d1bd9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:20.035199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3851ee9f-44cd-4a78-89cb-614a4d1bd9cd None None] MFA Rules not processed for user `0832de36f3d04557bb401ed9f9b14ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:20.036439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3851ee9f-44cd-4a78-89cb-614a4d1bd9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:20.055753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 845/1733] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:20.082784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71709-d5c2-4ccd-9c3c-778b7c1b5fea None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:20.082784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71709-d5c2-4ccd-9c3c-778b7c1b5fea None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:20.082784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71709-d5c2-4ccd-9c3c-778b7c1b5fea None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:20.084441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 889/1734] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jun 20 12:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:20.096159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3e713-a84d-4112-8cdd-8d3b753f517a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:20.096598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3e713-a84d-4112-8cdd-8d3b753f517a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:20.096987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3e713-a84d-4112-8cdd-8d3b753f517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:20.184938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-61d3e713-a84d-4112-8cdd-8d3b753f517a None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:20.188256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-61d3e713-a84d-4112-8cdd-8d3b753f517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:20.348349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:20.406235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71709-d5c2-4ccd-9c3c-778b7c1b5fea None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:20.410370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 846/1735] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jun 20 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:20.423530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:20.441988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71709-d5c2-4ccd-9c3c-778b7c1b5fea None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:20.465980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893a200-0ba5-4aea-8bcb-a106dcc87e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:20.465980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893a200-0ba5-4aea-8bcb-a106dcc87e83 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:20.465980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893a200-0ba5-4aea-8bcb-a106dcc87e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:20.466356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893a200-0ba5-4aea-8bcb-a106dcc87e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:20.486968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893a200-0ba5-4aea-8bcb-a106dcc87e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:20.491749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893a200-0ba5-4aea-8bcb-a106dcc87e83 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:20.533603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 890/1736] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:20.990804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5cff-5fe9-4563-a971-0e1ad45c47fa None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:20.991694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5cff-5fe9-4563-a971-0e1ad45c47fa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:20.991976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5cff-5fe9-4563-a971-0e1ad45c47fa None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:20.993737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 847/1737] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jun 20 12:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:21.006049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:21.012144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:21.012144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:21.055110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:21.057162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:21.088377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 891/1738] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:21.109573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b5cff-5fe9-4563-a971-0e1ad45c47fa None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:21.121660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-329b5cff-5fe9-4563-a971-0e1ad45c47fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:21.283482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:21.285910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:21.356927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b5cff-5fe9-4563-a971-0e1ad45c47fa None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:21.367615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:21.368537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:21.369926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:21.371652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:21.405082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:21.415700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:21.456037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 848/1739] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:21.515346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7692-9641-46e4-8c6d-9512ed9ba245 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:21.535169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:21.538466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:21.539575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:21.539956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] PATH_INFO: `/v3/projects/1c387f53134747e4889731f7140a5117` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:21.560369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c387f53134747e4889731f7140a5117)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:21.567380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:21.760953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:21.807136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c387f53134747e4889731f7140a5117', 'request_id': 'req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:21.918415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c387f53134747e4889731f7140a5117', 'request_id': 'req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:21.928432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c387f53134747e4889731f7140a5117', 'request_id': 'req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:21.996564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] The token cache is being invalidate because project 1c387f53134747e4889731f7140a5117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:21.996564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.005920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24ff2c0d-f4ab-4681-b053-dac7ab16a4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.010211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 892/1740] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:21 2022] DELETE /identity/v3/projects/1c387f53134747e4889731f7140a5117 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:22.014433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:22.041592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a1b52-8ab8-4f90-8c92-331c39f5237c service glance] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:22.168507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.169853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.170601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:22.203435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:22.206181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.206181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.206181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] PATH_INFO: `/v3/users/c8bb30f6c8ab46d880bef95f3dcaea3d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:22.207571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bb30f6c8ab46d880bef95f3dcaea3d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:22.210303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:22.233546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] MFA Rules not processed for user `c7b99b14245d49d68589866ceffeadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:22.235461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:22.400637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 893/1741] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:22.418131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:22.419857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:22.526520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b78d-9801-4894-a690-8df1c82811c9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:22.532199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bb30f6c8ab46d880bef95f3dcaea3d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.533492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad9fa1-0243-4782-b877-22f530eafc9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:22.534468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9fa1-0243-4782-b877-22f530eafc9c service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.535980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9fa1-0243-4782-b877-22f530eafc9c service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.535980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9fa1-0243-4782-b877-22f530eafc9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:22.550403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad9fa1-0243-4782-b877-22f530eafc9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:22.553135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad9fa1-0243-4782-b877-22f530eafc9c service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:22.557770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bb30f6c8ab46d880bef95f3dcaea3d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.581141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 894/1742] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:22.582321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429396-4392-4de7-813c-510555b385c6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.582758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429396-4392-4de7-813c-510555b385c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.583189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429396-4392-4de7-813c-510555b385c6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:22.593633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 895/1743] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jun 20 12:28:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:22.599926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.600895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.601320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:22.657152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bb30f6c8ab46d880bef95f3dcaea3d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.661054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:22.671874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bb30f6c8ab46d880bef95f3dcaea3d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.673560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bb30f6c8ab46d880bef95f3dcaea3d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:22.697661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 849/1744] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:22 2022] DELETE /identity/v3/users/c8bb30f6c8ab46d880bef95f3dcaea3d => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:22.704107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:22.705338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:22.818519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 896/1745] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:28:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:22.830542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:22.833018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:22.877305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:22.878874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:22.899299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c5c1c-b95c-45d3-9f9e-af8c2329b1bf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:22.905449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6b108-6b2e-4938-8c79-80bb56d157f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:22.907015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6b108-6b2e-4938-8c79-80bb56d157f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.907497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6b108-6b2e-4938-8c79-80bb56d157f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.907949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6b108-6b2e-4938-8c79-80bb56d157f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:22.935879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6b108-6b2e-4938-8c79-80bb56d157f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:22.942426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6b108-6b2e-4938-8c79-80bb56d157f7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:22.962697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 897/1746] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:22.983835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:22.984355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:22.986306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:23.036295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397e79-3f76-4a6e-94b1-35b9b31f3f89 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:23.063745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:23.064647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:23.064932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:23.065657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] PATH_INFO: `/v3/users/d9ee4bede7b643be81b25a5d06ee4f9a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:23.071531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ee4bede7b643be81b25a5d06ee4f9a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:23.073710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:23.077368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] MFA Rules not processed for user `f023004fda46413e878274519d68197c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:23.078812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:23.203020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 898/1747] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:23.219104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:23.220816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:23.394502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb63d94-899e-4d78-93a7-017813013906 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:23.412874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ee4bede7b643be81b25a5d06ee4f9a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:23.413421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:23.415408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:23.415814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:23.416198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:23.432334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ee4bede7b643be81b25a5d06ee4f9a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:23.440836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:23.442571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:23.461085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 899/1748] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:23.463308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:23.464190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:23.519682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ee4bede7b643be81b25a5d06ee4f9a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:23.540379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ee4bede7b643be81b25a5d06ee4f9a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:23.541952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0aee4077-2106-4572-b86c-d0609100c69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ee4bede7b643be81b25a5d06ee4f9a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:23.554295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 850/1749] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:22 2022] DELETE /identity/v3/users/d9ee4bede7b643be81b25a5d06ee4f9a => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:23.559639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:23.559639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:23.564619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:23.636758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:23.639787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:23.742294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a026cb-0745-44cf-898f-96ddd1749d89 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:23.871028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 851/1750] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:23.872267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:23.893397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:23.906304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:23.907484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:23.907910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:23.908458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:23.912204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:23.915101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ced4ce-3ec3-44f5-8a8d-6d61a466a496 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:23.922268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:23.923491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:23.924003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:23.924469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] PATH_INFO: `/v3/projects/dd5e68a66701433d8333cf866b6d7693` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:23.925977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5e68a66701433d8333cf866b6d7693)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:23.932033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:24.070608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:24.076673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cf8cc-4303-487f-b0d1-7028d7afaf46 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:24.132915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 900/1751] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:24.143052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af018-5d5d-47cd-81b5-1c4c9f42b0c8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.143818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af018-5d5d-47cd-81b5-1c4c9f42b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.144248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af018-5d5d-47cd-81b5-1c4c9f42b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:24.158906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5e68a66701433d8333cf866b6d7693', 'request_id': 'req-32ab5368-e183-4d4a-aa04-bfa26ac9f192'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:24.191280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5e68a66701433d8333cf866b6d7693', 'request_id': 'req-32ab5368-e183-4d4a-aa04-bfa26ac9f192'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:24.205830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-177af018-5d5d-47cd-81b5-1c4c9f42b0c8 None None] MFA Rules not processed for user `9ea06252769148759586242b0b5f562c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:24.207777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-177af018-5d5d-47cd-81b5-1c4c9f42b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.218947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5e68a66701433d8333cf866b6d7693', 'request_id': 'req-32ab5368-e183-4d4a-aa04-bfa26ac9f192'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:24.324362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] The token cache is being invalidate because project dd5e68a66701433d8333cf866b6d7693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:24.324959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:24.330625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:24.333364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 852/1752] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:23 2022] DELETE /identity/v3/projects/dd5e68a66701433d8333cf866b6d7693 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:24.334525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:24.336133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.363788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 901/1753] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:24.365570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677a51f-25eb-40e5-99e5-37c281ae7456 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.366647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677a51f-25eb-40e5-99e5-37c281ae7456 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.366951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677a51f-25eb-40e5-99e5-37c281ae7456 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:24.369162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 902/1754] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jun 20 12:28:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:24.369933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677a51f-25eb-40e5-99e5-37c281ae7456 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:24.371879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e677a51f-25eb-40e5-99e5-37c281ae7456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.411497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:24.501595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:24.603907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab5368-e183-4d4a-aa04-bfa26ac9f192 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:24.619380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:24.620056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.621719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.621719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:24.634162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.640470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677a51f-25eb-40e5-99e5-37c281ae7456 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:24.647772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:24.653133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.653133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.653133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:24.653133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.670221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:24.672200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d14a8e-359e-447b-af46-9524883061fd service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:24.688157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 903/1755] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:24.689619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800c88-2956-470f-af43-1c2e0bb74759 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.689920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800c88-2956-470f-af43-1c2e0bb74759 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.690545 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85800c88-2956-470f-af43-1c2e0bb74759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:24.744631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-85800c88-2956-470f-af43-1c2e0bb74759 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:24.746613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-85800c88-2956-470f-af43-1c2e0bb74759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.863698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:24.865225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac8365-941a-4631-9dc9-5a89fa43fe4b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:24.915242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 853/1756] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:24.923821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.924009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.924301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:24.972951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 904/1757] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:24.981554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:24.985325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:24.992032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:24.992032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:24.992032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.093147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:25.095402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:25.146723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 905/1758] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:25.152917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.190699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94590e9-82ac-45e7-9ea0-f2d1588265e9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.191214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 854/1759] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:25.215584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.218131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.219682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.220848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.224244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:25.224839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.228885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:25.252004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.263335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd213c-a44d-45a9-9ee6-028495566065 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.292122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.293092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.294120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.295518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.297806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 906/1760] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:25.302264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.334552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.335836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:25.343049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f18b72-c80f-4c62-aadb-ab515fc07485 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.353608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.354589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.355024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.355542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.356521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.359429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:25.374237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 855/1761] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:25.507794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 907/1762] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:25 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:25.511908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.531371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f33aa-2af4-4d53-9b2e-e6687ff8abb1 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.703735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.704705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.705134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.705567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.706533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.711798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:25.816076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 856/1763] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:25 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:25.819746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.830586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06011-cca4-4a22-a2f3-88972d376032 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.836864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.837579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.838057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.838348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.839155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.841199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:25.867734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 908/1764] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:25.871407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.886541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c3f31-e380-444a-a5b6-e31d726c4d30 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.898755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0e1c-6d2a-440f-bfc2-d80227f7173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.899690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0e1c-6d2a-440f-bfc2-d80227f7173e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.900166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0e1c-6d2a-440f-bfc2-d80227f7173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.900619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0e1c-6d2a-440f-bfc2-d80227f7173e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.901701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab0e1c-6d2a-440f-bfc2-d80227f7173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.907814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab0e1c-6d2a-440f-bfc2-d80227f7173e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:25.932612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 857/1765] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:25.934112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:25.947480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97b5d1-606c-4d0f-9a23-31473622e2c1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:25.965654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:25.967421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:25.967421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:25.967421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] PATH_INFO: `/v3/projects/9685c71db4d6475c84e8859c1fe92e85/users/a09fc901363344d4bde5d746a8ec670e/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:25.990556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9685c71db4d6475c84e8859c1fe92e85, user_id=a09fc901363344d4bde5d746a8ec670e, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:25.993122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:26.107915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 909/1766] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:25 2022] PUT /identity/v3/projects/9685c71db4d6475c84e8859c1fe92e85/users/a09fc901363344d4bde5d746a8ec670e/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:26.118625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:26.118904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:26.119185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:26.183395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:26.200524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] MFA Rules not processed for user `a09fc901363344d4bde5d746a8ec670e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:26.201777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:26.377127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:26.426104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 858/1767] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:26.429436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:26.553641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69fcc5-1a86-422f-b00a-d9e746850e90 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:26.598453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:26.598453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:26.598453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:26.598453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:26.598807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:26.598807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:26.774241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 910/1768] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:26 2022] POST /identity/v3/projects => generated 379 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:26.777149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:26.802675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17761dde-5afa-45b9-94ff-a3716c2d9dd3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:26.813699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:26.816511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:26.959642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:26.960349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:26.960639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:26.960923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:26.961644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:26.971630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e7cac-88f5-4685-b899-b6dad9e16d8f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:26.977728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:26.990669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:26.990669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:26.990669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:26.990669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] PATH_INFO: `/v3/projects/f8353cd455854c7397eeeb90c2159a2f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:27.001109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8353cd455854c7397eeeb90c2159a2f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:27.005700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:27.129511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 859/1769] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:26 2022] POST /identity/v3/users => generated 296 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:27.130631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:27.133796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:27.163618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bd213-56e6-4cdc-8a15-21501e371679 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:27.195034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:27.200458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:27.202904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:27.204599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] PATH_INFO: `/v3/users/5dab7aa1f682412689e82da1e0d91a5b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:27.205071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8353cd455854c7397eeeb90c2159a2f', 'request_id': 'req-70e16dab-d5ee-4f19-b8fa-7af89b025eba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.208851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dab7aa1f682412689e82da1e0d91a5b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:27.213486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:27.303896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:27.354857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8353cd455854c7397eeeb90c2159a2f', 'request_id': 'req-70e16dab-d5ee-4f19-b8fa-7af89b025eba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.366425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8353cd455854c7397eeeb90c2159a2f', 'request_id': 'req-70e16dab-d5ee-4f19-b8fa-7af89b025eba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.401463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] The token cache is being invalidate because project f8353cd455854c7397eeeb90c2159a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:27.402945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.404903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.413404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 911/1770] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:26 2022] DELETE /identity/v3/projects/f8353cd455854c7397eeeb90c2159a2f => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:27.416700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:27.427389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:27.513603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dab7aa1f682412689e82da1e0d91a5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.525028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16dab-d5ee-4f19-b8fa-7af89b025eba admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:27.530712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:27.531217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:27.531587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:27.531905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:27.532613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:27.532841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dab7aa1f682412689e82da1e0d91a5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.534294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:27.550731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 912/1771] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:27.550731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:27.550731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:27.562595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a846f9e-6be1-4fde-b42c-a5f53135b59f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:27.567571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:27.568817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:27.569191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:27.569578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] PATH_INFO: `/v3/users/b393a3d34038463195ad622bbdf06e97` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:27.570943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b393a3d34038463195ad622bbdf06e97)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:27.573020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:27.652220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dab7aa1f682412689e82da1e0d91a5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.660508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dab7aa1f682412689e82da1e0d91a5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.661525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dab7aa1f682412689e82da1e0d91a5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.693232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 860/1772] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:27 2022] DELETE /identity/v3/users/5dab7aa1f682412689e82da1e0d91a5b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:27.694396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:27.697240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:27.802988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aad6e-f6fc-4cf3-b874-720696d187a7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:27.817281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b393a3d34038463195ad622bbdf06e97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.821023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028325b-d721-4f94-b9de-3ef222c76ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:27.824236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028325b-d721-4f94-b9de-3ef222c76ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:27.824533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028325b-d721-4f94-b9de-3ef222c76ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:27.824819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028325b-d721-4f94-b9de-3ef222c76ee8 admin admin] PATH_INFO: `/v3/projects/bfc04f9a635945b3b566845282a41b4e/users/f272515b483b4120b82398b780312b74/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:27.824991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b393a3d34038463195ad622bbdf06e97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.850849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b393a3d34038463195ad622bbdf06e97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.860944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b393a3d34038463195ad622bbdf06e97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:27.868472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028325b-d721-4f94-b9de-3ef222c76ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc04f9a635945b3b566845282a41b4e, user_id=f272515b483b4120b82398b780312b74, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:27.888552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028325b-d721-4f94-b9de-3ef222c76ee8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:27.994629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b393a3d34038463195ad622bbdf06e97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:28.001639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 861/1773] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:27 2022] PUT /identity/v3/projects/bfc04f9a635945b3b566845282a41b4e/users/f272515b483b4120b82398b780312b74/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:28.003386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65632e-7a2f-449e-b893-996abf46a5cc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.003875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65632e-7a2f-449e-b893-996abf46a5cc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.004780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65632e-7a2f-449e-b893-996abf46a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.004935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 913/1774] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:27 2022] DELETE /identity/v3/users/b393a3d34038463195ad622bbdf06e97 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:28.006018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:28.010101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.030121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:28.086051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3d65632e-7a2f-449e-b893-996abf46a5cc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:28.091184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3d65632e-7a2f-449e-b893-996abf46a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.137797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1a3e6-9adb-4735-9441-33f974005692 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:28.155038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:28.155747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.156008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.156286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.157130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:28.161307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:28.190660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 914/1775] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:28.194911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:28.213369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb835db0-d911-4590-b2d2-1bcb78f9d5d1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:28.231764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:28.233060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.233533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.233946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] PATH_INFO: `/v3/projects/bfc04f9a635945b3b566845282a41b4e/users/f272515b483b4120b82398b780312b74/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.236245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc04f9a635945b3b566845282a41b4e, user_id=f272515b483b4120b82398b780312b74, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:28.243111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:28.263083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 862/1776] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:28.269343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 915/1777] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:28 2022] PUT /identity/v3/projects/bfc04f9a635945b3b566845282a41b4e/users/f272515b483b4120b82398b780312b74/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:28.281392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.281892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.282742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.290872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:28.293006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.371121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] MFA Rules not processed for user `f272515b483b4120b82398b780312b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:28.372806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.455253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c5229-18f9-4d4d-b6dd-d2ff3876655e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:28.463332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:28.465675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.467040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.468065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.575058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 863/1778] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:28.583730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:28.586178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.649039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:28.653518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:28.679509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 916/1779] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:28.708735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d33ca-270a-42a1-892c-c45dfbb53618 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:28.713930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:28.714903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.715349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.715756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.718318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.834046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:28.876065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:28.879063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6ec21-5b75-4185-87e1-74dfc8d135d1 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:28.923594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 864/1780] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:29.126163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:29.153370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:29.156073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:29.187154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca8e7-7a2f-4423-9fee-e07fa4dcaa78 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:29.203147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:29.204092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:29.205659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:29.209562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] PATH_INFO: `/v3/projects/b8b74878e30146ba864acfd11723a7e2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:29.215058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b74878e30146ba864acfd11723a7e2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:29.217127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:29.470491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff0d71-a4c3-4636-aa1d-5b4c2d03c3fe None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:29.471937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff0d71-a4c3-4636-aa1d-5b4c2d03c3fe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:29.472447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff0d71-a4c3-4636-aa1d-5b4c2d03c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:29.480760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b74878e30146ba864acfd11723a7e2', 'request_id': 'req-bee4c478-b068-4d92-bd69-518377a58f3d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:29.508389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a6ff0d71-a4c3-4636-aa1d-5b4c2d03c3fe None None] MFA Rules not processed for user `c7b99b14245d49d68589866ceffeadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:29.509636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a6ff0d71-a4c3-4636-aa1d-5b4c2d03c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:29.604811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b74878e30146ba864acfd11723a7e2', 'request_id': 'req-bee4c478-b068-4d92-bd69-518377a58f3d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:29.614938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 865/1781] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:29.620532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b74878e30146ba864acfd11723a7e2', 'request_id': 'req-bee4c478-b068-4d92-bd69-518377a58f3d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:29.665246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] The token cache is being invalidate because project b8b74878e30146ba864acfd11723a7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:29.665621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:29.682714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bee4c478-b068-4d92-bd69-518377a58f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:29.693446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 917/1782] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:29 2022] DELETE /identity/v3/projects/b8b74878e30146ba864acfd11723a7e2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:29.699078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:29.699608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:29.700051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:29.747177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:29.748375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:29.925040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 866/1783] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:29.925616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:29.925616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:29.925616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:29.957078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:29.958518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:29.977639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:29.992090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4d004-b25d-48d6-a115-60677881e4ee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:29.999708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 918/1784] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:30.001793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:30.001940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:30.003818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.004712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.005687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:30.005948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.007002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:30.007392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:30.011060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:30.035540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 867/1785] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:30.056169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:30.086041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954410ae-d9ed-4557-b3d8-cee45b2e0a86 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:30.089242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20310044-c269-4541-9b48-f3c9e451cd84 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:30.115344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:30.115344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.119954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:30.120562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.121239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.121629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.122371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.122493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:30.122927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] PATH_INFO: `/v3/projects/98133ad60d2a448ca1afc5c7d9614e95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.124471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98133ad60d2a448ca1afc5c7d9614e95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:30.126618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:30.127267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:30.287564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 868/1786] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:30.292140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:30.411479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98133ad60d2a448ca1afc5c7d9614e95', 'request_id': 'req-599008ce-6458-4385-b44c-a82a6c6a6594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:30.432772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eda17-d950-440f-991e-67406c1bd045 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:30.525930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98133ad60d2a448ca1afc5c7d9614e95', 'request_id': 'req-599008ce-6458-4385-b44c-a82a6c6a6594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:30.538731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08e610-aa1d-4ec1-a7d8-537488a7d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:30.539642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e610-aa1d-4ec1-a7d8-537488a7d51d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.540075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e610-aa1d-4ec1-a7d8-537488a7d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.540499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e610-aa1d-4ec1-a7d8-537488a7d51d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.541162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98133ad60d2a448ca1afc5c7d9614e95', 'request_id': 'req-599008ce-6458-4385-b44c-a82a6c6a6594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:30.541760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08e610-aa1d-4ec1-a7d8-537488a7d51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:30.543927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08e610-aa1d-4ec1-a7d8-537488a7d51d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:30.569748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] The token cache is being invalidate because project 98133ad60d2a448ca1afc5c7d9614e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:30.570232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:30.570927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-599008ce-6458-4385-b44c-a82a6c6a6594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:30.573326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 919/1787] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:29 2022] DELETE /identity/v3/projects/98133ad60d2a448ca1afc5c7d9614e95 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:30.574845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.575181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.575536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.616487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] MFA Rules not processed for user `f023004fda46413e878274519d68197c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:30.617799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:30.679514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 920/1788] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:30.680373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:30.681935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:30.698376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 869/1789] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:30 2022] POST /identity/v3/users => generated 293 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:30.699806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.700283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.700568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.718054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8c79-bd7f-4852-90b5-85334fea370f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:30.724254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:30.725791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:30.725883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.726172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.726346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:30.726481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] PATH_INFO: `/v3/users/208b48c1ebad43c9941ec6c77b57b414` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.727876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208b48c1ebad43c9941ec6c77b57b414)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:30.730799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:30.871423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 870/1790] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:28:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:30.873699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:30.877896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:30.918917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4eda7-86a6-4f42-8d3d-8d265bea5473 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:30.935689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:30.936485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:30.936874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:30.937301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:30.938488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:30.940375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:30.967999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 871/1791] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:30.972366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:30.998743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b4923-4973-4f04-803b-d258a8149015 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:31.018113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:31.018965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.019413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.023201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.025068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:31.027108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:31.054761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 872/1792] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:31.055944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:31.068959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4640b-25e8-4cbe-928d-2f0f23270f9e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:31.088609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee38a61-7e62-4271-b339-970e37b74d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:31.088609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee38a61-7e62-4271-b339-970e37b74d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.088609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee38a61-7e62-4271-b339-970e37b74d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.088609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee38a61-7e62-4271-b339-970e37b74d31 admin admin] PATH_INFO: `/v3/projects/3808053566e94f6da6b61558ac0837db/users/77f5c0f7336748ce830090d9901152a8/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.102788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee38a61-7e62-4271-b339-970e37b74d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3808053566e94f6da6b61558ac0837db, user_id=77f5c0f7336748ce830090d9901152a8, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:31.109024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee38a61-7e62-4271-b339-970e37b74d31 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:31.212953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208b48c1ebad43c9941ec6c77b57b414'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:31.214431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208b48c1ebad43c9941ec6c77b57b414'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:31.251903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 873/1793] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:31 2022] PUT /identity/v3/projects/3808053566e94f6da6b61558ac0837db/users/77f5c0f7336748ce830090d9901152a8/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:31.252116 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208b48c1ebad43c9941ec6c77b57b414'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:31.253574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.253865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.254170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.272628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208b48c1ebad43c9941ec6c77b57b414'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:31.298268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] MFA Rules not processed for user `77f5c0f7336748ce830090d9901152a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:31.299525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.410698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208b48c1ebad43c9941ec6c77b57b414'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:31.421520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 921/1794] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:30 2022] DELETE /identity/v3/users/208b48c1ebad43c9941ec6c77b57b414 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:31.424051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:31.426099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.456530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 874/1795] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:31.456530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:31.460885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.587490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08e00-da89-4e65-8567-9f9b4dad01f8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:31.601719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700256-2fce-416f-9efa-264f4a131593 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:31.606383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:31.607097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.607444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.607748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.609703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.679331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:31.680057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.680396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.680681 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.683699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.692168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:31.693682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:31.706305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 922/1796] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:31.707595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:31.714062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:31.716016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.845393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a82ac-fb08-4d02-adff-0f3336345f90 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:31.852601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:31.853490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.854031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.854537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.855458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:31.859341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:31.921889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:31.923960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037418ae-e876-4b99-8ea1-a4cda3cbb1ec service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:31.936842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 875/1797] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:28:31.936842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:31.936842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:31.936842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:31.961319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:31.962510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:31.977021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 923/1798] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:31 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:31.977935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:32.110736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464e1d-c27b-43d4-bc15-844eaf9a959b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:32.119389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:32.120171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.120561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.120889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.121678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:32.125187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:32.172473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 876/1799] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:28:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:32.187727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:32.191089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:32.236515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd964-57ed-482c-bdde-0cf1efceff60 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:32.253612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:32.258422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.258739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.259149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.265608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 924/1800] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:31 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:32.274448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:32.291748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82827-620c-4b8e-9688-cbbd80808088 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:32.293424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:32.298591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:32.299921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:32.301044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.301406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.301697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.304904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:32.304904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:32.309417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 877/1801] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:32.337037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 925/1802] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:32.340769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:32.362946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b110-0154-4067-9762-f3861d0bca02 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:32.374119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407f19b-9fe1-4773-8acd-772cac72e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:32.374939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407f19b-9fe1-4773-8acd-772cac72e194 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.375239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407f19b-9fe1-4773-8acd-772cac72e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.375660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407f19b-9fe1-4773-8acd-772cac72e194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.377231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407f19b-9fe1-4773-8acd-772cac72e194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:32.378109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407f19b-9fe1-4773-8acd-772cac72e194 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:32.397054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 878/1803] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:32.399890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:32.418431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da606f2-eef2-42e5-b49f-a7fd175be481 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:32.428761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:32.437518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.437518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.437518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] PATH_INFO: `/v3/projects/4f8f6f92511f42bbab58162c33594880/users/129db36011a045f5985c06ab043df79b/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.457686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8f6f92511f42bbab58162c33594880, user_id=129db36011a045f5985c06ab043df79b, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:32.462982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:32.464038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:32.580697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 926/1804] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:32 2022] PUT /identity/v3/projects/4f8f6f92511f42bbab58162c33594880/users/129db36011a045f5985c06ab043df79b/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:32.596852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.597178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.597424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.646057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] MFA Rules not processed for user `129db36011a045f5985c06ab043df79b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:32.652617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:32.753200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:32.964115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 879/1805] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:32.968976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:33.221049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893b21-f876-4cd7-bc0d-0f3d1d9ff2e1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:33.242818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d374539-94af-436e-bcf6-f4dfc76931d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:33.252491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d374539-94af-436e-bcf6-f4dfc76931d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:33.252792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d374539-94af-436e-bcf6-f4dfc76931d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:33.253100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d374539-94af-436e-bcf6-f4dfc76931d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:33.253873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d374539-94af-436e-bcf6-f4dfc76931d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:33.271679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d374539-94af-436e-bcf6-f4dfc76931d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:33.472353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 927/1806] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:32 2022] POST /identity/v3/projects => generated 383 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:33.477312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:33.504625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892255e5-61e4-4582-9b72-06eb9051a3ee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:33.888185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:33.888185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:33.888185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:33.890500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:33.890500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:33.890500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:33.890500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:33.891776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:33.891776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:33.892974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:33.892974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:33.892974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 928/1807] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jun 20 12:28:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:33.983022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:33.983022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:33.988656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495471bc-e378-43eb-ae43-5d175f3503bd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:34.005162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:34.005839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.006155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.006470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.027906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:34.029483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:34.041898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 929/1808] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:34.267713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:34.271485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 880/1809] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:33 2022] POST /identity/v3/users => generated 298 bytes in 795 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:34.278763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:34.296675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ec8b-0e50-474a-bb9e-997c84d1fe3f service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:34.311119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:34.311724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.312019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.312307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.313570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:34.317239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:34.361940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:34.362426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 930/1810] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:34.374255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337beaba-3dc5-4111-a302-0da5409e923f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:34.399079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:34.399079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.399079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.399079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] PATH_INFO: `/v3/projects/c9779e3e7f38411ba1fd36de17f0bf1c/users/eb3f186ad9fd419b949b40a0894fc1ab/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.404191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:34.415431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:34.464552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d921c-4b6d-4dd3-8b48-7bf6851caa1d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:34.475208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9779e3e7f38411ba1fd36de17f0bf1c, user_id=eb3f186ad9fd419b949b40a0894fc1ab, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:34.489043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:34.491310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:34.492213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.498329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.498329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] PATH_INFO: `/v3/projects/0214965192b74612b4d29b72f53ead55` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.498329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0214965192b74612b4d29b72f53ead55)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:34.499310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:34.633150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 881/1811] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:34 2022] PUT /identity/v3/projects/c9779e3e7f38411ba1fd36de17f0bf1c/users/eb3f186ad9fd419b949b40a0894fc1ab/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:34.637423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:34.725667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6304eb-062b-4ac3-a6f2-3d22ed6ed362 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:34.744413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0214965192b74612b4d29b72f53ead55', 'request_id': 'req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:34.849351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0214965192b74612b4d29b72f53ead55', 'request_id': 'req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:34.857791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0214965192b74612b4d29b72f53ead55', 'request_id': 'req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:34.862367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:34.863391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.863920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.864382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.865346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:34.867921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:34.891275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 882/1812] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:34.892868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:34.906760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] The token cache is being invalidate because project 0214965192b74612b4d29b72f53ead55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:34.908411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:34.909219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b12b-c7e7-4e91-b3bd-98a0e11a114b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:34.910839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c247e3f5-9da0-4533-a7eb-50d9351ee8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:34.916630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2743ae-94fc-4eb3-9318-1dea56de1dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:34.920733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 931/1813] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:34 2022] DELETE /identity/v3/projects/0214965192b74612b4d29b72f53ead55 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:34.921101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2743ae-94fc-4eb3-9318-1dea56de1dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.921101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2743ae-94fc-4eb3-9318-1dea56de1dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.921101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2743ae-94fc-4eb3-9318-1dea56de1dff admin admin] PATH_INFO: `/v3/projects/c9779e3e7f38411ba1fd36de17f0bf1c/users/eb3f186ad9fd419b949b40a0894fc1ab/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.921564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2743ae-94fc-4eb3-9318-1dea56de1dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9779e3e7f38411ba1fd36de17f0bf1c, user_id=eb3f186ad9fd419b949b40a0894fc1ab, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:34.924536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02301211-bb34-4196-a399-9cf003746a99 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.924835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02301211-bb34-4196-a399-9cf003746a99 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.925122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02301211-bb34-4196-a399-9cf003746a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:34.926031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2743ae-94fc-4eb3-9318-1dea56de1dff admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:34.941558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 883/1814] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:34 2022] PUT /identity/v3/projects/c9779e3e7f38411ba1fd36de17f0bf1c/users/eb3f186ad9fd419b949b40a0894fc1ab/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:34.978459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:34.979186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:34.979829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:35.001904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-02301211-bb34-4196-a399-9cf003746a99 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:35.003727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-02301211-bb34-4196-a399-9cf003746a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:35.041773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] MFA Rules not processed for user `eb3f186ad9fd419b949b40a0894fc1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:35.043198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:35.190178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 932/1815] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:35.198045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:35.198414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:35.198857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:35.200002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 884/1816] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:35.223774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:35.227164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:35.230473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:35.243503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:35.246246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:35.260242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 933/1817] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:35.264223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:35.286872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e32aa-6488-42a2-808b-e3c4f23ea46d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:35.298201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:35.303862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:35.303862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:35.303862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:35.303862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:35.303862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:35.303862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:35.333256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 934/1818] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:35.339292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:35.372832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f1b0f-aed2-4b70-872b-0fe9a9fdefcc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:35.381931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:35.383896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:35.384432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:35.385006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:35.388264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:35.390862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:35.419056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034363d-6ec2-44dc-b672-a50d4caef408 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:35.426409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:35.427659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:35.428741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:35.429144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:35.453525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:35.454814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:35.470830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 885/1819] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:35.472997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:35.544496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 935/1820] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:35 2022] POST /identity/v3/projects => generated 363 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:35.549037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:35.590996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9645f-3f23-4619-a19e-5ea49ceff522 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:35.764185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:35.765044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:35.765245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:35.766948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:35.768676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:35.773197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:36.000503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 886/1821] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:35 2022] POST /identity/v3/users => generated 282 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:36.004869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:36.018021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537235-b5af-48e7-b4e2-a9fd93d3bf42 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:36.046667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:36.047408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.047644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.047933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.048679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:36.050358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:36.110983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:36.111286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 936/1822] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:36.130894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4557f-d85e-44c4-afdd-8864dd8dff58 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:36.148259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c4ba-885e-4c4d-b0b1-03629faa9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:36.149140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c4ba-885e-4c4d-b0b1-03629faa9d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.149862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c4ba-885e-4c4d-b0b1-03629faa9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.149862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c4ba-885e-4c4d-b0b1-03629faa9d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.150805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c4ba-885e-4c4d-b0b1-03629faa9d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:36.164643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c4ba-885e-4c4d-b0b1-03629faa9d7d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:36.201569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:36.237344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd89f7-1e15-453b-93ed-4f43ee67c826 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:36.244645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 887/1823] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:36.246052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6ed4-1dba-461b-b793-4e24b144c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:36.247501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6ed4-1dba-461b-b793-4e24b144c9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.247991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6ed4-1dba-461b-b793-4e24b144c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.248430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6ed4-1dba-461b-b793-4e24b144c9e6 admin admin] PATH_INFO: `/v3/projects/d95ec6fb15244c2abf322117b9f4da58/users/7362686614334305801443048496c5cb/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.266943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb6ed4-1dba-461b-b793-4e24b144c9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95ec6fb15244c2abf322117b9f4da58, user_id=7362686614334305801443048496c5cb, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:36.280981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb6ed4-1dba-461b-b793-4e24b144c9e6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:36.285759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17f2c3-7982-4d1b-8af2-e0036f59249c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.286350 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17f2c3-7982-4d1b-8af2-e0036f59249c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.286844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17f2c3-7982-4d1b-8af2-e0036f59249c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.290397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 888/1824] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:28:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:28:36.310509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.311189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.311821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.340961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:36.350796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:36.392925 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 937/1825] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:36 2022] PUT /identity/v3/projects/d95ec6fb15244c2abf322117b9f4da58/users/7362686614334305801443048496c5cb/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:36.405035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.405401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.405689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.542388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 889/1826] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:28:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:36.580702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] MFA Rules not processed for user `7362686614334305801443048496c5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:36.587894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:36.777462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 938/1827] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:36.778715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:36.795281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c645ed9-d634-491e-86fe-73f0b19d1be2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:36.931105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:36.973625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:36.976444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:36.976736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:36.977020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:36.977740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:36.979772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:37.257563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:37.258588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 890/1828] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:36 2022] POST /identity/v3/projects => generated 365 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:37.259369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:37.266674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:37.359983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74365fe7-66d2-4822-89b1-2415c493606c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:37.368994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:37.385795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:37.386520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:37.387004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:37.387938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:37.390318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:37.453396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6cad8-cec1-4bba-a2e1-adb73d6cb2c1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:37.514901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 891/1829] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:37 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:37.518782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:37.536322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d49e-b69c-4a4e-a4ce-82a16e25c6f0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:37.560280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:37.560956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:37.561243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:37.561527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:37.564215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:37.568513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:37.605654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 892/1830] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:37.608611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:37.629952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7457f00-1f51-4736-aa53-519bb5e80ab0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:37.639012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:37.639863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:37.639863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:37.640146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:37.658479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:37.664049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:37.666867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:37.669922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:37.670475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:37.671652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] PATH_INFO: `/v3/projects/239e399d36c44c85b499ea7a9aa29014/users/a2bd738fba28434ab9fe763a344e6cb7/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:37.697147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 939/1831] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:37.711168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239e399d36c44c85b499ea7a9aa29014, user_id=a2bd738fba28434ab9fe763a344e6cb7, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:37.714028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:37.815358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:37.817786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 893/1832] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:37 2022] PUT /identity/v3/projects/239e399d36c44c85b499ea7a9aa29014/users/a2bd738fba28434ab9fe763a344e6cb7/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:37.827352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fce97d-98bf-48a3-b93f-bc9467a02768 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:37.848705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:37.850735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:37.957775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:37.958871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:37.959328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:37.959765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:37.960724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:37.962716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:37.969160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119b15-d933-4568-939b-54e224128327 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:37.976645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 940/1833] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:37.978115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:38.011862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:38.014829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:38.022891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:38.022891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] PATH_INFO: `/v3/users/a09fc901363344d4bde5d746a8ec670e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:38.022891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09fc901363344d4bde5d746a8ec670e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:38.022891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:38.088000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828ade-9239-4ab6-be09-7d76c6a06475 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:38.098578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:38.105825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:38.126563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:38.133342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:38.133342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:38.305572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:38.308335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:38.333739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09fc901363344d4bde5d746a8ec670e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:38.342141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 941/1834] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:38.343235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:38.359023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09fc901363344d4bde5d746a8ec670e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:38.388456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4d381-1f8b-4f5e-ba3e-f940481b8cdc service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:38.404774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a6f9-5f1d-4997-b6cb-abbbb8807a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:38.405838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a6f9-5f1d-4997-b6cb-abbbb8807a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:38.406272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a6f9-5f1d-4997-b6cb-abbbb8807a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:38.406710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a6f9-5f1d-4997-b6cb-abbbb8807a7c admin admin] PATH_INFO: `/v3/projects/239e399d36c44c85b499ea7a9aa29014/users/a2bd738fba28434ab9fe763a344e6cb7/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:38.409019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a6f9-5f1d-4997-b6cb-abbbb8807a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=239e399d36c44c85b499ea7a9aa29014, user_id=a2bd738fba28434ab9fe763a344e6cb7, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:38.416541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a6f9-5f1d-4997-b6cb-abbbb8807a7c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:38.433950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09fc901363344d4bde5d746a8ec670e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:38.442859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09fc901363344d4bde5d746a8ec670e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:38.443655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90cd761e-03f8-44b7-8f7c-eda5db172775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09fc901363344d4bde5d746a8ec670e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:38.453342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 942/1835] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:38 2022] PUT /identity/v3/projects/239e399d36c44c85b499ea7a9aa29014/users/a2bd738fba28434ab9fe763a344e6cb7/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:38.469828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 894/1836] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:37 2022] DELETE /identity/v3/users/a09fc901363344d4bde5d746a8ec670e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:38.470064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:38.470064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:38.470064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:38.471601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:38.472061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:38.472369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:38.493485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:38.495073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:38.506657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:38.576497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] MFA Rules not processed for user `a2bd738fba28434ab9fe763a344e6cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:38.577742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:38.635208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 895/1837] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:38.659999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:38.661039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:38.814911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea79e32-cd98-4fd5-bda5-2f308ae3d62a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:38.821340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 943/1838] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:38.833620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:38.839951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:38.842458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:38.842458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:38.842842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:38.843371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:38.868780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:38.868780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:38.899050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 896/1839] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:38.999862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880db85-2351-4bee-ad03-46c28e696214 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:39.009860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:39.010623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:39.010916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:39.011199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:39.040991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:39.042613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:39.063888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 944/1840] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:39.511092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:39.523262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d7c9a-2a45-453d-8b24-f0c9ecce915f service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:39.527803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:39.528461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:39.528934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:39.529226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:39.531457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:39.648057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:39.652229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:39.702723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:39.715275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 897/1841] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:40.027293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:40.755896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:40.758265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:40.786134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61215e9e-1e6f-4544-b32f-f553c8e1e25b service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:40.794038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:40.795295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:40.796445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:40.797265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] PATH_INFO: `/v3/projects/9685c71db4d6475c84e8859c1fe92e85` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:40.807511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9685c71db4d6475c84e8859c1fe92e85)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:40.820424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:40.997425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9685c71db4d6475c84e8859c1fe92e85', 'request_id': 'req-1d853c72-3670-4f41-83be-dbc189da94e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.096365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9685c71db4d6475c84e8859c1fe92e85', 'request_id': 'req-1d853c72-3670-4f41-83be-dbc189da94e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.106883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9685c71db4d6475c84e8859c1fe92e85', 'request_id': 'req-1d853c72-3670-4f41-83be-dbc189da94e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.137424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] The token cache is being invalidate because project 9685c71db4d6475c84e8859c1fe92e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:41.138615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.140234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1d853c72-3670-4f41-83be-dbc189da94e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.148095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:41.151317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 945/1842] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:40 2022] DELETE /identity/v3/projects/9685c71db4d6475c84e8859c1fe92e85 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:41.163129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5dabf-1d3a-4b88-8f5a-b3d15c250ef9 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:41.264167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:41.265529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:41.265873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:41.266410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] PATH_INFO: `/v3/users/f272515b483b4120b82398b780312b74` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:41.268064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f272515b483b4120b82398b780312b74)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:41.270681 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:41.549153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f272515b483b4120b82398b780312b74'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.617312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f272515b483b4120b82398b780312b74'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.699072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f272515b483b4120b82398b780312b74'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.707860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f272515b483b4120b82398b780312b74'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.712882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45a3b5bf-8a9c-40c4-b3bc-de3233724844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f272515b483b4120b82398b780312b74'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:41.720217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:41.737785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 898/1843] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:41 2022] DELETE /identity/v3/users/f272515b483b4120b82398b780312b74 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:41.801632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:42.805446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91208c9f-369c-4cf0-9f79-6f46917c78d4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:42.806017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91208c9f-369c-4cf0-9f79-6f46917c78d4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:42.806017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91208c9f-369c-4cf0-9f79-6f46917c78d4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:42.810488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 946/1844] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:28:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:42.821025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:42.821594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:42.821594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:42.875836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:42.877107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:43.085756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 899/1845] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:28:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:43.135923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91208c9f-369c-4cf0-9f79-6f46917c78d4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:43.138536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91208c9f-369c-4cf0-9f79-6f46917c78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:43.159706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91208c9f-369c-4cf0-9f79-6f46917c78d4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:43.169444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bbfa0-c1c5-44a5-b10c-f2311f822e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:43.170768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bbfa0-c1c5-44a5-b10c-f2311f822e27 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:43.171406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bbfa0-c1c5-44a5-b10c-f2311f822e27 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:43.171933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bbfa0-c1c5-44a5-b10c-f2311f822e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:43.187179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bbfa0-c1c5-44a5-b10c-f2311f822e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:43.192291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bbfa0-c1c5-44a5-b10c-f2311f822e27 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:43.226533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 947/1846] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:43.496259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:43.499356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:43.624557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845e37-2876-4268-a1d9-0e7c1af4d503 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:43.636748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:43.636748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:43.636748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:43.636748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] PATH_INFO: `/v3/projects/bfc04f9a635945b3b566845282a41b4e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:43.638616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc04f9a635945b3b566845282a41b4e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:43.643654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:43.875857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc04f9a635945b3b566845282a41b4e', 'request_id': 'req-31defda8-0a40-4f2f-afd6-3fffc59732d9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:43.893478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc04f9a635945b3b566845282a41b4e', 'request_id': 'req-31defda8-0a40-4f2f-afd6-3fffc59732d9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:43.904989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc04f9a635945b3b566845282a41b4e', 'request_id': 'req-31defda8-0a40-4f2f-afd6-3fffc59732d9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:43.997521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] The token cache is being invalidate because project bfc04f9a635945b3b566845282a41b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:43.997823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:44.000479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-31defda8-0a40-4f2f-afd6-3fffc59732d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:44.003619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 900/1847] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:43 2022] DELETE /identity/v3/projects/bfc04f9a635945b3b566845282a41b4e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:44.011891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.013761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.014627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.046396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:44.047927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:44.092810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:44.160890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 948/1848] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:44.169222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.169597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.169907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.205614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:44.206905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:44.218533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 901/1849] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:44.221148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.237271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526d59f-d74e-4ab5-ba3e-33f1c74b118e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.255318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.256159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.256542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.256888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.257704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:44.258103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.259790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:44.280053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 949/1850] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:44.280791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.295464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cbb3e-a3fe-4b7f-9eda-70f97187ff38 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.304280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.305871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.307745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.308005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.308880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.311808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:44.518968 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 902/1851] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:44 2022] POST /identity/v3/projects => generated 399 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:44.524239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.552159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2f04d-573e-49f1-a8db-0c4dd048bc38 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.585054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:44.708449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.710331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.714876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.715217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.715979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.721869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:44.835965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.838237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 950/1852] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:44 2022] POST /identity/v3/users => generated 300 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:44.854775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da706c-61f1-418f-b608-937d7e7b8825 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.858624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.859915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.860618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.861018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.862029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.864161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:44.879832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 903/1853] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:44.884456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.911059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065962-4a52-4c05-9b9d-87b6f27fa4f5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.922899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.926256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:44.933514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.934423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.937212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.937212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.937212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.937975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:44.943192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0677-4d3b-41ce-9be0-77f71a3a04bf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.951133 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.952284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.952805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.953304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] PATH_INFO: `/v3/users/7362686614334305801443048496c5cb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.954926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7362686614334305801443048496c5cb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.956452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 951/1854] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:44.957482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:44.961484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:44.971628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424007-80c3-4042-a8dc-eeedeaa8e5f5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:44.977412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fa9ba-f5b6-4a97-8626-9cc128e64096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:44.978279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa9ba-f5b6-4a97-8626-9cc128e64096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:44.978569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa9ba-f5b6-4a97-8626-9cc128e64096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:44.978940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa9ba-f5b6-4a97-8626-9cc128e64096 admin admin] PATH_INFO: `/v3/projects/3d23ea320c9b4274bcae002410366c6d/users/fbb19a25c1fc4712ad00f94a03549af8/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:44.994532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fa9ba-f5b6-4a97-8626-9cc128e64096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d23ea320c9b4274bcae002410366c6d, user_id=fbb19a25c1fc4712ad00f94a03549af8, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:44.997226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fa9ba-f5b6-4a97-8626-9cc128e64096 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:45.346982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 952/1855] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:44 2022] PUT /identity/v3/projects/3d23ea320c9b4274bcae002410366c6d/users/fbb19a25c1fc4712ad00f94a03549af8/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:45.357743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:45.358061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:45.358347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:45.391831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] MFA Rules not processed for user `fbb19a25c1fc4712ad00f94a03549af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:45.393604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:45.460700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7362686614334305801443048496c5cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.467071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 953/1856] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:45.471535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:45.474104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7362686614334305801443048496c5cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.549347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efce48d-46e6-4bd0-ae3a-af803fe58481 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:45.554149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424d8cb-c088-4203-bce8-a3f085322574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:45.554843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d8cb-c088-4203-bce8-a3f085322574 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:45.555152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d8cb-c088-4203-bce8-a3f085322574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:45.555437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d8cb-c088-4203-bce8-a3f085322574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:45.556298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424d8cb-c088-4203-bce8-a3f085322574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:45.558499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424d8cb-c088-4203-bce8-a3f085322574 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:45.593318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7362686614334305801443048496c5cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.601173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7362686614334305801443048496c5cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.601930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7362686614334305801443048496c5cb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.608475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 904/1857] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:44 2022] DELETE /identity/v3/users/7362686614334305801443048496c5cb => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:45.609212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:45.610604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:45.673572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cc4b-9b6f-4252-80a6-e3d914528967 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:45.675532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 954/1858] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:45 2022] POST /identity/v3/projects => generated 401 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:45.679769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:45.680075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:45.680353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:45.698623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:45.699824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:45.730308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:45.731332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:45.731670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:45.731950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] PATH_INFO: `/v3/users/3ac011985b484073af103fab81877b5e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:45.733160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac011985b484073af103fab81877b5e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:45.735320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:45.758294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 955/1859] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:45.762199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:45.763950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:45.775862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf4c8-a4f9-40cc-b208-796f5af5f14b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:45.780419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:45.781105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:45.781362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:45.781639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:45.782365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:45.784266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:45.913344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 956/1860] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:45 2022] POST /identity/v3/users => generated 307 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:45.914370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:45.916148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:45.949450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac011985b484073af103fab81877b5e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.963160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac011985b484073af103fab81877b5e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:45.975482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f894a-c0c3-46fa-b429-493b07cc9ce6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:45.979146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:45.979821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:45.980103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:45.980460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:45.989426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:45.991491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.001120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 957/1861] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:46.002126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.012096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217571b-29b8-40c4-a9c5-ac1c8f3e90bc service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.012288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:46.017000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.023154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.023154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.023154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.023154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.023154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.031613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 958/1862] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:46.035674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.039588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac011985b484073af103fab81877b5e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:46.046283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089bfb-237d-49cb-8ab6-eeb38a1cfa63 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.048191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac011985b484073af103fab81877b5e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:46.053508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0e1b50-1185-457d-afe7-f9daa5698d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac011985b484073af103fab81877b5e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:46.053781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.053781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.053781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.053781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] PATH_INFO: `/v3/projects/2c34bcad66cf415db2af64579e41936d/users/23076acbbfc8450ba93b65698f1692b7/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.060594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 905/1863] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:45 2022] DELETE /identity/v3/users/3ac011985b484073af103fab81877b5e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:46.062142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.062586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.062878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.074544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c34bcad66cf415db2af64579e41936d, user_id=23076acbbfc8450ba93b65698f1692b7, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.077740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.087824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:46.088984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.158031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 906/1864] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:46.166363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.167843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.223947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43796b97-412d-4ec2-8a97-54eb24579bc5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.228284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.228931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.229214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.229493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.239022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.239541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 959/1865] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:46 2022] PUT /identity/v3/projects/2c34bcad66cf415db2af64579e41936d/users/23076acbbfc8450ba93b65698f1692b7/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:46.240530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.243177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.244804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.250448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 907/1866] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:46.340688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c75189-712d-46ea-b72f-f8b21ddeabfb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.347278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42acdd7-8ce2-483e-9189-2a6966ccf057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.347968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42acdd7-8ce2-483e-9189-2a6966ccf057 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.348446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42acdd7-8ce2-483e-9189-2a6966ccf057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.348730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42acdd7-8ce2-483e-9189-2a6966ccf057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.350590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42acdd7-8ce2-483e-9189-2a6966ccf057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.355788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42acdd7-8ce2-483e-9189-2a6966ccf057 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.366752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 960/1867] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:46.371125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.390273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fd94-2d3d-414d-8ec5-14b160dfe1d5 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.396155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.398566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.398928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.399282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] PATH_INFO: `/v3/projects/2c34bcad66cf415db2af64579e41936d/users/23076acbbfc8450ba93b65698f1692b7/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.404323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c34bcad66cf415db2af64579e41936d, user_id=23076acbbfc8450ba93b65698f1692b7, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.410241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.423142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 908/1868] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:46 2022] PUT /identity/v3/projects/2c34bcad66cf415db2af64579e41936d/users/23076acbbfc8450ba93b65698f1692b7/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:46.434754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.437194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.437194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.466860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] MFA Rules not processed for user `23076acbbfc8450ba93b65698f1692b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:46.468087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.547242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 961/1869] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:46.558559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.560445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.632969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3811e-835f-469c-9124-1135419d5de9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.641279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.645460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.645753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.646273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.658610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.660402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.672008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 909/1870] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:46.686033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.688321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.804222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecf347-09ad-4e80-9d62-43754a8d0a68 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.809835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:46.810757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:46.811052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:46.811327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] PATH_INFO: `/v3/projects/d95ec6fb15244c2abf322117b9f4da58` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:46.813150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95ec6fb15244c2abf322117b9f4da58)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:46.815344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:46.954298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:46.954298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:46.962704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d17878-5831-4b96-a6a0-33e09f0b32ff service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:46.984094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95ec6fb15244c2abf322117b9f4da58', 'request_id': 'req-62cdb74a-4953-467d-bd16-c376acc498e0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.021855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:47.022738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:47.023025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:47.023305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] PATH_INFO: `/v3/projects/26f10400882f47da95c17a3eb4d6cb2f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:47.024475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f10400882f47da95c17a3eb4d6cb2f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:47.026417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:47.095618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95ec6fb15244c2abf322117b9f4da58', 'request_id': 'req-62cdb74a-4953-467d-bd16-c376acc498e0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.103126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95ec6fb15244c2abf322117b9f4da58', 'request_id': 'req-62cdb74a-4953-467d-bd16-c376acc498e0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.116767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] The token cache is being invalidate because project d95ec6fb15244c2abf322117b9f4da58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:47.117057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.117835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.119446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 962/1871] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:46 2022] DELETE /identity/v3/projects/d95ec6fb15244c2abf322117b9f4da58 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:47.120342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:47.121667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:47.181779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f10400882f47da95c17a3eb4d6cb2f', 'request_id': 'req-979c0b40-cdc9-42c7-9235-a3b7d9d33236'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.183414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdb74a-4953-467d-bd16-c376acc498e0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:47.189804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f10400882f47da95c17a3eb4d6cb2f', 'request_id': 'req-979c0b40-cdc9-42c7-9235-a3b7d9d33236'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.196216 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f10400882f47da95c17a3eb4d6cb2f', 'request_id': 'req-979c0b40-cdc9-42c7-9235-a3b7d9d33236'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.239778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:47.241101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:47.241391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:47.241677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:47.243632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:47.319820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] The token cache is being invalidate because project 26f10400882f47da95c17a3eb4d6cb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:47.320034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.321351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.326160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 910/1872] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:46 2022] DELETE /identity/v3/projects/26f10400882f47da95c17a3eb4d6cb2f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:47.326160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:47.326414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:47.327653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:47.330924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:47.339026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 963/1873] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:47.340000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:47.341467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:47.346960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c0b40-cdc9-42c7-9235-a3b7d9d33236 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:47.351933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:47.352791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:47.353473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:47.353933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:47.356461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:47.428920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facbb81-757b-4a9c-82b7-1ca841a9102d service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:47.434697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:47.436472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:47.437147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:47.437532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] PATH_INFO: `/v3/users/a2bd738fba28434ab9fe763a344e6cb7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:47.437867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:47.439029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bd738fba28434ab9fe763a344e6cb7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:47.440204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:47.441367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:47.458797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 911/1874] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:47.461502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:47.462981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:47.482497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abda0f-9062-41ba-a1ef-67e25124de40 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:47.488580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:47.489629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:47.491690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:47.492158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] PATH_INFO: `/v3/users/4613267954b14d38adf8546476ddb8a7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:47.493635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4613267954b14d38adf8546476ddb8a7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:47.496661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:47.700018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bd738fba28434ab9fe763a344e6cb7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.700806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bd738fba28434ab9fe763a344e6cb7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.727453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bd738fba28434ab9fe763a344e6cb7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.734179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bd738fba28434ab9fe763a344e6cb7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.809787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4613267954b14d38adf8546476ddb8a7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.825084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4613267954b14d38adf8546476ddb8a7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.830289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bd738fba28434ab9fe763a344e6cb7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.844884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 964/1875] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:47 2022] DELETE /identity/v3/users/a2bd738fba28434ab9fe763a344e6cb7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:47.925183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4613267954b14d38adf8546476ddb8a7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.935897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4613267954b14d38adf8546476ddb8a7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.936615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4613267954b14d38adf8546476ddb8a7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:47.944530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 912/1876] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:47 2022] DELETE /identity/v3/users/4613267954b14d38adf8546476ddb8a7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:48.511078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:48.514443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:48.566141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:48.576955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:48.578957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:48.626777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44b586-8f7c-446b-9bdd-e51d52fd2d4b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:48.662927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855a08e-a244-4dfc-9402-c47b96d2f451 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:48.667953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:48.668820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:48.669538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:48.669826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] PATH_INFO: `/v3/projects/55ad65ea06c5493b8edaa375b6771b6a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:48.671066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ad65ea06c5493b8edaa375b6771b6a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:48.673026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:48.680833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:48.681956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:48.682267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:48.682539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] PATH_INFO: `/v3/projects/239e399d36c44c85b499ea7a9aa29014` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:48.683748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=239e399d36c44c85b499ea7a9aa29014)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:48.685640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:48.822115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ad65ea06c5493b8edaa375b6771b6a', 'request_id': 'req-c66ec63a-e298-488d-809c-547989629511'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:48.828256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ad65ea06c5493b8edaa375b6771b6a', 'request_id': 'req-c66ec63a-e298-488d-809c-547989629511'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:48.832127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:48.836402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ad65ea06c5493b8edaa375b6771b6a', 'request_id': 'req-c66ec63a-e298-488d-809c-547989629511'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:48.857902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239e399d36c44c85b499ea7a9aa29014', 'request_id': 'req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:48.922867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] The token cache is being invalidate because project 55ad65ea06c5493b8edaa375b6771b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:48.923081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:48.923719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c66ec63a-e298-488d-809c-547989629511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:48.925270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 913/1877] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:48 2022] DELETE /identity/v3/projects/55ad65ea06c5493b8edaa375b6771b6a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:48.930396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e883752-c1d4-4c17-a8d3-db31e16c4eb2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:48.930678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e883752-c1d4-4c17-a8d3-db31e16c4eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:48.930954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e883752-c1d4-4c17-a8d3-db31e16c4eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:48.949064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1e883752-c1d4-4c17-a8d3-db31e16c4eb2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:48.950328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1e883752-c1d4-4c17-a8d3-db31e16c4eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:49.010268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 914/1878] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:49.017820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.018152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.018415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.020390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239e399d36c44c85b499ea7a9aa29014', 'request_id': 'req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.028148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239e399d36c44c85b499ea7a9aa29014', 'request_id': 'req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.036582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:49.038447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:49.042259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] The token cache is being invalidate because project 239e399d36c44c85b499ea7a9aa29014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:49.042259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.042259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0b60263-11ec-4d9d-8421-5c1f3e11dc5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.042784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 965/1879] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:48 2022] DELETE /identity/v3/projects/239e399d36c44c85b499ea7a9aa29014 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:49.047040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 915/1880] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:49.051426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0c0b-bea3-49f8-92ff-479913f126ef None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.051595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.052091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0c0b-bea3-49f8-92ff-479913f126ef None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.052382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0c0b-bea3-49f8-92ff-479913f126ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.061370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2aa55-ca5a-468b-a374-20b899561ffc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.067741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.068551 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.068895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.069160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.069899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:49.070249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.072574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.089261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ed0e0c0b-bea3-49f8-92ff-479913f126ef None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:49.094025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ed0e0c0b-bea3-49f8-92ff-479913f126ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:49.101370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 916/1881] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:28:49.102329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.119077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 966/1882] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:49.123575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d16249-eef6-4cbd-bc07-fc2aeafaadbc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.133211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.135503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.135813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.140963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.141914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.149806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.150296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.151635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.155230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.172848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:49.174310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:49.183347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 967/1883] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:49.189945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.201318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaec17-f4a9-45ab-bfdd-86e756841216 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.210245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.210245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.210245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.210245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.210865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:49.211283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.213585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.234736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 968/1884] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:28:49.236331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.247432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8071-dcdb-4411-b82d-09c62434d478 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.254708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.255400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.255692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.256005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.256721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.258712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.359526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 917/1885] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/projects => generated 367 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:49.365797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.434680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1b45-0662-4be9-9169-35197869764e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.440865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.441554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.441837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.442153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.442856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.445385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.532274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 969/1886] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:49.536376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.608425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab587796-7b46-45b2-8fec-c61158ea102c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.614434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.615131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.615455 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.615743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.616449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.618615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.631804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 918/1887] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/users => generated 284 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:49.633037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.643826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65208e-d7a9-426c-84d0-7888e096826f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.649381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.650080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.650364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.650637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.651361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.652964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.665022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 919/1888] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:49.668720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.679697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738862b-4a43-4aab-851d-11d2b775c28d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.688928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.689491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.689780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.690161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.690947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.692594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.707575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 920/1889] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:49.709668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.720335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a989-e059-4307-9c1d-27fcad8a0414 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.725735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dcdca-8145-4677-822b-b2ed87e0222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.727213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dcdca-8145-4677-822b-b2ed87e0222c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.727213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dcdca-8145-4677-822b-b2ed87e0222c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.727213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dcdca-8145-4677-822b-b2ed87e0222c admin admin] PATH_INFO: `/v3/projects/ec30194cb60d4568af599640621c8d1b/users/dfd26de8af094c5094c15a7625a63bba/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.733207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 970/1890] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:49.738399 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.760638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc9ee-5d2c-49ec-a00e-206dd53e340c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.770963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dcdca-8145-4677-822b-b2ed87e0222c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec30194cb60d4568af599640621c8d1b, user_id=dfd26de8af094c5094c15a7625a63bba, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.780457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.780457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.780457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.780457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.780925 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.780925 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.781776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dcdca-8145-4677-822b-b2ed87e0222c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.804035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 971/1891] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:49.804035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.812494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e7e2-2d32-445e-9de6-9fd3869201cd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.819087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.819764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.820051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.820393 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.821059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.822714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.833761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 972/1892] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:49.840885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.851435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979a1a8-f888-4f8d-8795-6bb1f941f40a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.856292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39499-a6aa-4aa1-b7a0-1dfbd718a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.857193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39499-a6aa-4aa1-b7a0-1dfbd718a0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.857477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39499-a6aa-4aa1-b7a0-1dfbd718a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.857755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39499-a6aa-4aa1-b7a0-1dfbd718a0f2 admin admin] PATH_INFO: `/v3/projects/bacce1c52af444a7bf3f55cefef31e8c/users/ded1d2be651e48cd99cf703b9c453b03/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.870785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 921/1893] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:49 2022] PUT /identity/v3/projects/ec30194cb60d4568af599640621c8d1b/users/dfd26de8af094c5094c15a7625a63bba/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:49.874725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c39499-a6aa-4aa1-b7a0-1dfbd718a0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacce1c52af444a7bf3f55cefef31e8c, user_id=ded1d2be651e48cd99cf703b9c453b03, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.877733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c39499-a6aa-4aa1-b7a0-1dfbd718a0f2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.882957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.883330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.883618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.910887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] MFA Rules not processed for user `dfd26de8af094c5094c15a7625a63bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:49.912284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:49.980596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 922/1894] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:49.984946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.994774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 973/1895] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:49 2022] PUT /identity/v3/projects/bacce1c52af444a7bf3f55cefef31e8c/users/ded1d2be651e48cd99cf703b9c453b03/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:50.007784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:50.008160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:50.008522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:50.041231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] MFA Rules not processed for user `ded1d2be651e48cd99cf703b9c453b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:50.043280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:50.074923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715745a5-f8b6-48b1-9244-074a5d362194 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:50.113053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 974/1896] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:50.117782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:50.132839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:50.133514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:50.133795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:50.134114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:50.134808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:50.136751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:50.180485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e75d4e-9c7c-4802-ad7a-d91c36e102f6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:50.185526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:50.186324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:50.186619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:50.186906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:50.187753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:50.189729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:50.235318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 923/1897] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:49 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:50.239216 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:50.300566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b1454-06c5-4af2-ad34-e4caebb396f9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:50.308243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:50.309196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:50.309513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:50.309869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:50.310652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:50.313307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.258890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 975/1898] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:50 2022] POST /identity/v3/projects => generated 381 bytes in 1142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:51.262740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.323618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47a091-f8aa-436f-9a11-cfa0ace415d1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.328177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.328842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.329127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.329407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.330115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.332047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.603228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 924/1899] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:50 2022] POST /identity/v3/users => generated 291 bytes in 1364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:51.609125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.624663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e03f-9e0d-4a35-9ce9-0e453e989e57 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.635286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.639550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.639550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.639550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.639550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.639550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.650862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 925/1900] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:51.654808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.669626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945a91-25bb-4372-b157-01d6ea718660 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.675351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.676239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.676519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.676791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] PATH_INFO: `/v3/projects/faf34adf0405430c8063ee793da36f2c/users/6d26ea1825c34e919ad7c3dad6e97037/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.697955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 976/1901] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:51 2022] POST /identity/v3/users => generated 297 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:51.699660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf34adf0405430c8063ee793da36f2c, user_id=6d26ea1825c34e919ad7c3dad6e97037, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.702386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.706458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.721591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c480f-7a6f-4490-a889-fc4a27beaae2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.741159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.742265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.742989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.743470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.744594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.746937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.760611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 977/1902] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:51.765325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.777793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02477-7389-4bbd-9587-fc065418142d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.782983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.784008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.784373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.784818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] PATH_INFO: `/v3/projects/37b9eaf39e754fd8b8b3a6c448378b27/users/9295d857eb0a474cb0b586f8f147f010/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.804141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b9eaf39e754fd8b8b3a6c448378b27, user_id=9295d857eb0a474cb0b586f8f147f010, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.807363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.834059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 926/1903] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:51 2022] PUT /identity/v3/projects/faf34adf0405430c8063ee793da36f2c/users/6d26ea1825c34e919ad7c3dad6e97037/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:51.837897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.894682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 978/1904] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:51 2022] PUT /identity/v3/projects/37b9eaf39e754fd8b8b3a6c448378b27/users/9295d857eb0a474cb0b586f8f147f010/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:51.898586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.908960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43383-bd3b-4185-9511-e5549b3fe626 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.962751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95dc4d-ec9b-425c-b6b3-f6b8bcf9ef15 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.967669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.968405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.968757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.968912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:51.969254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.969700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:51.969987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:51.970118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.974695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:51.974695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:51.975373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.975459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:51.982130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 979/1905] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:51.983445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 927/1906] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:28:51.986627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.987127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:51.996321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c11b-b7bc-424a-9326-05b90817d910 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:51.996651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bbe6f-244b-4232-89c4-d781a4effb74 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:52.001115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bb575-f5da-4fe0-9291-9164b54b2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:52.001666 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72091a1-7aaf-48ed-85f5-d1eacceea7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:52.002037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb575-f5da-4fe0-9291-9164b54b2cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:52.002332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb575-f5da-4fe0-9291-9164b54b2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:52.002573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72091a1-7aaf-48ed-85f5-d1eacceea7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:52.002672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb575-f5da-4fe0-9291-9164b54b2cd4 admin admin] PATH_INFO: `/v3/projects/37b9eaf39e754fd8b8b3a6c448378b27/users/9295d857eb0a474cb0b586f8f147f010/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:52.002889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72091a1-7aaf-48ed-85f5-d1eacceea7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:52.003169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72091a1-7aaf-48ed-85f5-d1eacceea7e7 admin admin] PATH_INFO: `/v3/projects/faf34adf0405430c8063ee793da36f2c/users/6d26ea1825c34e919ad7c3dad6e97037/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:52.004577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bb575-f5da-4fe0-9291-9164b54b2cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b9eaf39e754fd8b8b3a6c448378b27, user_id=9295d857eb0a474cb0b586f8f147f010, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:52.005165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72091a1-7aaf-48ed-85f5-d1eacceea7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf34adf0405430c8063ee793da36f2c, user_id=6d26ea1825c34e919ad7c3dad6e97037, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:52.007396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bb575-f5da-4fe0-9291-9164b54b2cd4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:52.007911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72091a1-7aaf-48ed-85f5-d1eacceea7e7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:52.027687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 980/1907] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:51 2022] PUT /identity/v3/projects/37b9eaf39e754fd8b8b3a6c448378b27/users/9295d857eb0a474cb0b586f8f147f010/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:52.027873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 928/1908] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:51 2022] PUT /identity/v3/projects/faf34adf0405430c8063ee793da36f2c/users/6d26ea1825c34e919ad7c3dad6e97037/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:52.031214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:52.031333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:52.031774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:52.032105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:52.032220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:52.033419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:52.070942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] MFA Rules not processed for user `9295d857eb0a474cb0b586f8f147f010`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:52.072198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:52.083448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] MFA Rules not processed for user `6d26ea1825c34e919ad7c3dad6e97037`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:52.085537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:52.173395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 981/1909] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:52.180813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 929/1910] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:52.226832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:52.228317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:52.288769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44499be2-e027-48c1-97c7-dcc6442ff072 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:52.294664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:52.295332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:52.295616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:52.295895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:52.305783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:52.307641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:52.317883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 982/1911] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:52.500752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:52.511594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658abb-facc-4795-9471-d22c48136b7c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:52.515451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:52.516168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:52.516459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:52.516736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:52.575629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:52.577088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:52.586932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 930/1912] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:52.622373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:53.073288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:53.163712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:53.165142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:53.176266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118463-8f2e-43cb-8f14-0ef0e429b58f service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:53.180684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9363fb-9b95-4af2-af0a-9caf422e0de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:53.181329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9363fb-9b95-4af2-af0a-9caf422e0de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:53.181861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9363fb-9b95-4af2-af0a-9caf422e0de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:53.182184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9363fb-9b95-4af2-af0a-9caf422e0de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:53.192065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9363fb-9b95-4af2-af0a-9caf422e0de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:53.194519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9363fb-9b95-4af2-af0a-9caf422e0de5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:53.205691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 983/1913] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:53.276429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:53.277955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:53.365466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80643e-debb-4e27-83d0-bfaf52c29c0b service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:53.371440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:53.372337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:53.372618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:53.372893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] PATH_INFO: `/v3/users/77f5c0f7336748ce830090d9901152a8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:53.374208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f5c0f7336748ce830090d9901152a8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:53.376277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:53.595875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f5c0f7336748ce830090d9901152a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:53.608197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f5c0f7336748ce830090d9901152a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:53.713722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f5c0f7336748ce830090d9901152a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:53.721525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f5c0f7336748ce830090d9901152a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:53.722206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f5c0f7336748ce830090d9901152a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:53.732384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 931/1914] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:53 2022] DELETE /identity/v3/users/77f5c0f7336748ce830090d9901152a8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:53.734558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4085-393c-4796-8e0e-9414e4570ec9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:53.735096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4085-393c-4796-8e0e-9414e4570ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:53.735793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4085-393c-4796-8e0e-9414e4570ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:53.753317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1a7d4085-393c-4796-8e0e-9414e4570ec9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:53.754567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1a7d4085-393c-4796-8e0e-9414e4570ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:53.813382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 984/1915] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:53.823410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:53.824831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:53.888474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035ebb-9fbb-4259-8a9d-4a4cde9864bc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:53.894132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dbb3a-5b66-45d4-a559-4b63acf8ce14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:53.894864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dbb3a-5b66-45d4-a559-4b63acf8ce14 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:53.895153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dbb3a-5b66-45d4-a559-4b63acf8ce14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:53.895435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dbb3a-5b66-45d4-a559-4b63acf8ce14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:53.907003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dbb3a-5b66-45d4-a559-4b63acf8ce14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:53.908489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dbb3a-5b66-45d4-a559-4b63acf8ce14 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:53.922766 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 932/1916] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:54.125159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22426-558d-490d-9071-8b92b3b94a27 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.125455 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22426-558d-490d-9071-8b92b3b94a27 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.125726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22426-558d-490d-9071-8b92b3b94a27 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.127299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 985/1917] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:28:54.139797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.140502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.140979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.143600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:54.160401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:54.161586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:54.230975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 933/1918] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:28:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:54.244198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db22426-558d-490d-9071-8b92b3b94a27 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.246016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1db22426-558d-490d-9071-8b92b3b94a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:54.271008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db22426-558d-490d-9071-8b92b3b94a27 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.278035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.278837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.279234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.279621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.291460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.293319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:54.307537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 986/1919] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:54.442822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.444776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:54.457830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.459425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:54.480434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6ada-6137-4cf6-b3af-e35dcc0be63c service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.488558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.489439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.489736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.490009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] PATH_INFO: `/v3/projects/3808053566e94f6da6b61558ac0837db` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.494997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3808053566e94f6da6b61558ac0837db)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.494997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:54.532500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e15bf-8991-4e45-8fdc-4c4d3725792d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.538353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9295d857eb0a474cb0b586f8f147f010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37b9eaf39e754fd8b8b3a6c448378b27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.539068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.539420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.539760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.540659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:54.541054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.544535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:54.562411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 934/1920] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:54.566657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.579182 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9ba8-1ab3-4a1e-adbc-5b0d6d37c8ae tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.585531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9295d857eb0a474cb0b586f8f147f010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37b9eaf39e754fd8b8b3a6c448378b27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.586344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.587274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.587638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.588750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.591181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:54.649923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3808053566e94f6da6b61558ac0837db', 'request_id': 'req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:54.705694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 935/1921] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:54 2022] POST /identity/v3/projects => generated 354 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:54.709362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.777664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4b35-50ea-4a9f-bfe3-6e6d4e311739 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.782291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9295d857eb0a474cb0b586f8f147f010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37b9eaf39e754fd8b8b3a6c448378b27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.782949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.783230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.783514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.784231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:54.784540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.786178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:54.793051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3808053566e94f6da6b61558ac0837db', 'request_id': 'req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:54.800596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3808053566e94f6da6b61558ac0837db', 'request_id': 'req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:54.804928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 936/1922] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:28:54.818603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] The token cache is being invalidate because project 3808053566e94f6da6b61558ac0837db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:54.818603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:54.818603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:54.819008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 987/1923] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:54 2022] DELETE /identity/v3/projects/3808053566e94f6da6b61558ac0837db => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:54.822816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.824551 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:54.853590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:54.855162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:54.896754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ce96-6e0d-46a1-8bf1-be2209ad88a3 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.901756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.902987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.903273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.903550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] PATH_INFO: `/v3/users/129db36011a045f5985c06ab043df79b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.904765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129db36011a045f5985c06ab043df79b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.906938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:54.931112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac359-b8bb-4c22-95c8-bf8b1dfcebbf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:54.936178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9295d857eb0a474cb0b586f8f147f010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37b9eaf39e754fd8b8b3a6c448378b27', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:54.937046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:54.937335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:54.937617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] PATH_INFO: `/v3/projects/abade8c39af14e48bd7856637a3a420d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:54.938933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abade8c39af14e48bd7856637a3a420d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:54.940858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:55.165286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abade8c39af14e48bd7856637a3a420d', 'request_id': 'req-14f43ff6-4026-45a8-817e-426fc26b1919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.170523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129db36011a045f5985c06ab043df79b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.187670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129db36011a045f5985c06ab043df79b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.228157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abade8c39af14e48bd7856637a3a420d', 'request_id': 'req-14f43ff6-4026-45a8-817e-426fc26b1919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.239597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abade8c39af14e48bd7856637a3a420d', 'request_id': 'req-14f43ff6-4026-45a8-817e-426fc26b1919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.270999 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] The token cache is being invalidate because project abade8c39af14e48bd7856637a3a420d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:55.272082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.278622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.281618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 988/1924] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:54 2022] DELETE /identity/v3/projects/abade8c39af14e48bd7856637a3a420d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:55.284636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:55.297794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:55.313861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129db36011a045f5985c06ab043df79b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.333518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129db36011a045f5985c06ab043df79b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.336365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129db36011a045f5985c06ab043df79b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.349329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 937/1925] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:54 2022] DELETE /identity/v3/users/129db36011a045f5985c06ab043df79b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:55.387148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43ff6-4026-45a8-817e-426fc26b1919 tempest-VolumeQuotaClassesTest-1240663957 tempest-VolumeQuotaClassesTest-1240663957-project-admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:55.449138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:55.450213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:55.450575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:55.450866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] PATH_INFO: `/v3/users/fbb19a25c1fc4712ad00f94a03549af8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:55.452128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb19a25c1fc4712ad00f94a03549af8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:55.454151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:55.576454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:55.777077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb19a25c1fc4712ad00f94a03549af8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.777803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb19a25c1fc4712ad00f94a03549af8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.791101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb19a25c1fc4712ad00f94a03549af8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.799526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb19a25c1fc4712ad00f94a03549af8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.875983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:55.877371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:55.898971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3400-ae17-4156-981a-0464c12a5d64 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:55.907450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-85fd8be6-4bf2-48d0-966d-2ee205b2c136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb19a25c1fc4712ad00f94a03549af8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:55.907616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:55.908722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:55.909077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:55.909442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] PATH_INFO: `/v3/projects/4f8f6f92511f42bbab58162c33594880` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:55.912692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8f6f92511f42bbab58162c33594880)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:55.919877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:55.931593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 989/1926] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:55 2022] DELETE /identity/v3/users/fbb19a25c1fc4712ad00f94a03549af8 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:55.937065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:55.939758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:55.940118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:55.965550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:55.972974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:55.974230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:56.032205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8f6f92511f42bbab58162c33594880', 'request_id': 'req-5dc5904b-2d5d-4430-93dc-8a50202b3068'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.042258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8f6f92511f42bbab58162c33594880', 'request_id': 'req-5dc5904b-2d5d-4430-93dc-8a50202b3068'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.048435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8f6f92511f42bbab58162c33594880', 'request_id': 'req-5dc5904b-2d5d-4430-93dc-8a50202b3068'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.070073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 990/1927] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:56.076437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:56.078012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:56.142206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] The token cache is being invalidate because project 4f8f6f92511f42bbab58162c33594880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:56.142986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.143201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.145071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 938/1928] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:55 2022] DELETE /identity/v3/projects/4f8f6f92511f42bbab58162c33594880 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:56.153784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:56.155891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:56.180009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a737e-5046-4887-b574-fa3a6111f29b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:56.244694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5904b-2d5d-4430-93dc-8a50202b3068 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:56.244694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:56.244694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:56.244694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:56.245513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] PATH_INFO: `/v3/users/eb3f186ad9fd419b949b40a0894fc1ab` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:56.245513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3f186ad9fd419b949b40a0894fc1ab)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:56.246858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:56.261102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:56.262139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:56.262435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:56.262722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:56.264608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:56.285878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:56.288321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:56.304833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 991/1929] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:56.307291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:56.310356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:56.327668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ccbd-5f38-4d0f-825b-6bf8bc3e733d service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:56.333716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:56.336051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:56.336895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:56.336895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] PATH_INFO: `/v3/users/ded1d2be651e48cd99cf703b9c453b03` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:56.339056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded1d2be651e48cd99cf703b9c453b03)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:56.341554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:56.468449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3f186ad9fd419b949b40a0894fc1ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.503499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3f186ad9fd419b949b40a0894fc1ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.600196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3f186ad9fd419b949b40a0894fc1ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.611960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3f186ad9fd419b949b40a0894fc1ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.611960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69f0f60d-cbfe-49fe-a2b3-b8242be794d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3f186ad9fd419b949b40a0894fc1ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.622941 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 939/1930] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:56 2022] DELETE /identity/v3/users/eb3f186ad9fd419b949b40a0894fc1ab => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:56.628356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded1d2be651e48cd99cf703b9c453b03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.628789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded1d2be651e48cd99cf703b9c453b03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.644292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded1d2be651e48cd99cf703b9c453b03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.653708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded1d2be651e48cd99cf703b9c453b03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.873604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded1d2be651e48cd99cf703b9c453b03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:56.885206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 992/1931] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:56 2022] DELETE /identity/v3/users/ded1d2be651e48cd99cf703b9c453b03 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:56.887127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:56.887438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:56.887707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:56.922399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:56.923645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.008695 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 940/1932] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:57.024320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.025981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.107731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7554-ba3f-400d-b7bf-0888ec0c8e48 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.118016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.118697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.118991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.119274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.136450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.138718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.150282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 993/1933] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:57.166860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.169153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.194542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752acc-02d1-491b-803f-a7fea65a63c5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.201334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.202228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.202508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.202794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] PATH_INFO: `/v3/projects/3d23ea320c9b4274bcae002410366c6d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.203996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d23ea320c9b4274bcae002410366c6d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.205927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.251904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.253462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.271161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69eef8-de46-4a97-b859-fabe42d16fab service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.278574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.279567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.280053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.280403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] PATH_INFO: `/v3/projects/c9779e3e7f38411ba1fd36de17f0bf1c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.281864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9779e3e7f38411ba1fd36de17f0bf1c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.284788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.353688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d23ea320c9b4274bcae002410366c6d', 'request_id': 'req-868897c7-be7a-4b9a-a41b-e83325e0050c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.361507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d23ea320c9b4274bcae002410366c6d', 'request_id': 'req-868897c7-be7a-4b9a-a41b-e83325e0050c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.367954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d23ea320c9b4274bcae002410366c6d', 'request_id': 'req-868897c7-be7a-4b9a-a41b-e83325e0050c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.398687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9779e3e7f38411ba1fd36de17f0bf1c', 'request_id': 'req-33afdf22-5c3e-44a4-80c8-f0076de131fd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.411139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:57.439060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] The token cache is being invalidate because project 3d23ea320c9b4274bcae002410366c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:57.439366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.440152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.441853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 941/1934] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:57 2022] DELETE /identity/v3/projects/3d23ea320c9b4274bcae002410366c6d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:57.448191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.449582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.479196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9779e3e7f38411ba1fd36de17f0bf1c', 'request_id': 'req-33afdf22-5c3e-44a4-80c8-f0076de131fd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.486982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9779e3e7f38411ba1fd36de17f0bf1c', 'request_id': 'req-33afdf22-5c3e-44a4-80c8-f0076de131fd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.498154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] The token cache is being invalidate because project c9779e3e7f38411ba1fd36de17f0bf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:57.498716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.499555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-33afdf22-5c3e-44a4-80c8-f0076de131fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.506123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 994/1935] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:57 2022] DELETE /identity/v3/projects/c9779e3e7f38411ba1fd36de17f0bf1c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:57.507634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62cd07-0256-41ef-b02d-71103f6267cc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.507930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62cd07-0256-41ef-b02d-71103f6267cc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.508223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62cd07-0256-41ef-b02d-71103f6267cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.519346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868897c7-be7a-4b9a-a41b-e83325e0050c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.527491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-aa62cd07-0256-41ef-b02d-71103f6267cc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:57.529048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aa62cd07-0256-41ef-b02d-71103f6267cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.582414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.583292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.583621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.584451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] PATH_INFO: `/v3/users/23076acbbfc8450ba93b65698f1692b7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.588564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23076acbbfc8450ba93b65698f1692b7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.590567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.613460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 995/1936] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:57.615386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.615787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.616397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.639693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:57.639693 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.648197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 996/1937] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:57.653631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.664853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dda770-add6-4d3f-bdb5-16f1df319ba2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.670081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.670950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.671360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.671737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.672639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:57.673049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.675154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.693909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 997/1938] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:28:57.693909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.698182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.711939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81571-a565-40bc-b270-f634ab765efe admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.716888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.717786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.718106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.718396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] PATH_INFO: `/v3/projects/bacce1c52af444a7bf3f55cefef31e8c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.719586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacce1c52af444a7bf3f55cefef31e8c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.721500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.839582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:57.852403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23076acbbfc8450ba93b65698f1692b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.868127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23076acbbfc8450ba93b65698f1692b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.878691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacce1c52af444a7bf3f55cefef31e8c', 'request_id': 'req-586c7799-bab6-4cf6-97d6-03f44d952484'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.959548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23076acbbfc8450ba93b65698f1692b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.972936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23076acbbfc8450ba93b65698f1692b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.974128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23076acbbfc8450ba93b65698f1692b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:57.982687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 942/1939] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:57 2022] DELETE /identity/v3/users/23076acbbfc8450ba93b65698f1692b7 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:57.983580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.985296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.045329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacce1c52af444a7bf3f55cefef31e8c', 'request_id': 'req-586c7799-bab6-4cf6-97d6-03f44d952484'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.056139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacce1c52af444a7bf3f55cefef31e8c', 'request_id': 'req-586c7799-bab6-4cf6-97d6-03f44d952484'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.063755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15bef1-c446-441e-8e17-ddd88d9633c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.069240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.070084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.070474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.070826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.071592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.073745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] The token cache is being invalidate because project bacce1c52af444a7bf3f55cefef31e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:58.073906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:58.074876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.076122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.082239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 998/1940] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:57 2022] DELETE /identity/v3/projects/bacce1c52af444a7bf3f55cefef31e8c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:58.083353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:58.085326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.165763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c7799-bab6-4cf6-97d6-03f44d952484 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.171149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.172213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.172573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.172920 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] PATH_INFO: `/v3/users/dfd26de8af094c5094c15a7625a63bba` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.174762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd26de8af094c5094c15a7625a63bba)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.178303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:58.222088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 943/1941] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:57 2022] POST /identity/v3/projects => generated 393 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:58.222088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:58.223857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.318494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1c73-0f99-404d-939c-db69aba7c98c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.318494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.318920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.318920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.319314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] PATH_INFO: `/v3/users/9295d857eb0a474cb0b586f8f147f010` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.320351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9295d857eb0a474cb0b586f8f147f010)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.322326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:58.375588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:58.569327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd26de8af094c5094c15a7625a63bba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.572406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd26de8af094c5094c15a7625a63bba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.585847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd26de8af094c5094c15a7625a63bba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.598897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd26de8af094c5094c15a7625a63bba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.614469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9295d857eb0a474cb0b586f8f147f010'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.627625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9295d857eb0a474cb0b586f8f147f010'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.707672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd26de8af094c5094c15a7625a63bba'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.714654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 999/1942] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:58 2022] DELETE /identity/v3/users/dfd26de8af094c5094c15a7625a63bba => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:58.715415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:58.716814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.780555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be39176-55b7-4dbc-83cc-8028e9856d89 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.785173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69398-379c-4da8-838d-b8d61d986a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.785841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69398-379c-4da8-838d-b8d61d986a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.786204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69398-379c-4da8-838d-b8d61d986a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.786491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69398-379c-4da8-838d-b8d61d986a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.787860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69398-379c-4da8-838d-b8d61d986a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.788272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9295d857eb0a474cb0b586f8f147f010'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.789810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69398-379c-4da8-838d-b8d61d986a1d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:58.796506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9295d857eb0a474cb0b586f8f147f010'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.797247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9295d857eb0a474cb0b586f8f147f010'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:58.805226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 944/1943] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:58 2022] DELETE /identity/v3/users/9295d857eb0a474cb0b586f8f147f010 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:58.807565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:58.807813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.881553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a469-1c76-45f0-b21e-a278f53b3d0c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.886966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.887830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.888146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.888427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] PATH_INFO: `/v3/projects/2c34bcad66cf415db2af64579e41936d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.890229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c34bcad66cf415db2af64579e41936d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.892190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:58.935582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1000/1944] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:58 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:58.939088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.939088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.939088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.955564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:58.956778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.965426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1001/1945] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:58.967527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:58.967527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.979764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647631b1-3b91-46f8-8de1-98c2ac273412 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.984840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.985500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.985945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.986223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.987031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.988526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.000541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1002/1946] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:59.001368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.003139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.037768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c34bcad66cf415db2af64579e41936d', 'request_id': 'req-b19853a7-dce0-4435-a53f-505971f3652b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.045876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c34bcad66cf415db2af64579e41936d', 'request_id': 'req-b19853a7-dce0-4435-a53f-505971f3652b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.051535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c34bcad66cf415db2af64579e41936d', 'request_id': 'req-b19853a7-dce0-4435-a53f-505971f3652b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.064192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382f3e-92d1-4ce9-9283-c065f67fa40e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.118040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211f95c-35fb-4c8a-9a46-bdf1559f4f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.119146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211f95c-35fb-4c8a-9a46-bdf1559f4f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.119146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211f95c-35fb-4c8a-9a46-bdf1559f4f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.119335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211f95c-35fb-4c8a-9a46-bdf1559f4f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.133815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] The token cache is being invalidate because project 2c34bcad66cf415db2af64579e41936d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:59.134286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.135225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.136993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 945/1947] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:58 2022] DELETE /identity/v3/projects/2c34bcad66cf415db2af64579e41936d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:59.140446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.140446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.193904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211f95c-35fb-4c8a-9a46-bdf1559f4f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.196089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211f95c-35fb-4c8a-9a46-bdf1559f4f92 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.210753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1003/1948] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:59.212318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cfa20-9d70-4e1d-9aba-a4504b85cf47 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.212583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cfa20-9d70-4e1d-9aba-a4504b85cf47 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.213077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cfa20-9d70-4e1d-9aba-a4504b85cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.240487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19853a7-dce0-4435-a53f-505971f3652b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.243573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3a1cfa20-9d70-4e1d-9aba-a4504b85cf47 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:59.243573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a1cfa20-9d70-4e1d-9aba-a4504b85cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.246473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.247209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.247605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.247907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.248825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.250445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.252993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1004/1949] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:59.261492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.261785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.262348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.265754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 946/1950] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:28:59.267652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.278661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64146a94-d731-4571-b1b3-36577c28e65d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.283453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.284332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.284616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.284891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] PATH_INFO: `/v3/projects/f048dbfd6eb640d69a24d1f7d8130fd8/users/c8daff2d40fb41b182fb0a4e2b59e735/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.285102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:59.286343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.295530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1005/1951] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:59.301114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f048dbfd6eb640d69a24d1f7d8130fd8, user_id=c8daff2d40fb41b182fb0a4e2b59e735, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.303902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.305601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.315235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191a97-4a17-4abe-b51a-45e31a9a6a7d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.320574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.321222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.321507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.321786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.322582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:28:59.322894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.324494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.336654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1006/1952] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:28:59.340834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.362910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88db82-19f9-41e9-a6f8-dc9974c6f36e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.376222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd9e6c-27c1-4814-a9d8-62e8a6c16bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.377233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9e6c-27c1-4814-a9d8-62e8a6c16bba admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.378182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9e6c-27c1-4814-a9d8-62e8a6c16bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.378684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9e6c-27c1-4814-a9d8-62e8a6c16bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.379638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd9e6c-27c1-4814-a9d8-62e8a6c16bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.382689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd9e6c-27c1-4814-a9d8-62e8a6c16bba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.399606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 947/1953] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:28:59 2022] PUT /identity/v3/projects/f048dbfd6eb640d69a24d1f7d8130fd8/users/c8daff2d40fb41b182fb0a4e2b59e735/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:28:59.410420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.413499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.486671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88d888-afae-453a-baf3-35e18e944b62 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.491984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.493003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.493804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.493804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] PATH_INFO: `/v3/projects/37b9eaf39e754fd8b8b3a6c448378b27` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.494844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b9eaf39e754fd8b8b3a6c448378b27)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.496754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.514132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1007/1954] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:28:59.515940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.516475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.517176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.550628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] MFA Rules not processed for user `c8daff2d40fb41b182fb0a4e2b59e735`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:59.551904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.620804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1008/1955] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:59.621644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.673492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:59.696949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821b7c4-6c47-41a4-9667-ebac0c526f75 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.710864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b9eaf39e754fd8b8b3a6c448378b27', 'request_id': 'req-b35a6530-1e78-4990-904f-12ac4efea10a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.718475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b9eaf39e754fd8b8b3a6c448378b27', 'request_id': 'req-b35a6530-1e78-4990-904f-12ac4efea10a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.724756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b9eaf39e754fd8b8b3a6c448378b27', 'request_id': 'req-b35a6530-1e78-4990-904f-12ac4efea10a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.769472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49852f8-9530-4cc0-98e9-7ac76f41c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.770271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49852f8-9530-4cc0-98e9-7ac76f41c584 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.770562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49852f8-9530-4cc0-98e9-7ac76f41c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.770903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49852f8-9530-4cc0-98e9-7ac76f41c584 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.772259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49852f8-9530-4cc0-98e9-7ac76f41c584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.774843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49852f8-9530-4cc0-98e9-7ac76f41c584 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.832406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] The token cache is being invalidate because project 37b9eaf39e754fd8b8b3a6c448378b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:59.832698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.833364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:59.835072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 948/1956] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:59 2022] DELETE /identity/v3/projects/37b9eaf39e754fd8b8b3a6c448378b27 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:59.836341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.837667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.850415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a6530-1e78-4990-904f-12ac4efea10a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:59.855136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:59.855767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.856054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.856334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.857011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:59.858981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:59.948376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1009/1957] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:59.950701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:59.951231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:59.951493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:59.970494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 949/1958] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:28:59.970494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:59.971127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:59.975583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:59.976795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.074604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1010/1959] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:00.075601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.076928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.089875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8719f1-0954-4b8b-8679-21fb5ec4944d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.096371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.097063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.097417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.098223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.098975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.101207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.101699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f56d-fff6-461f-9f50-c2666c1eb3fb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.106963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.107850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.108146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.108437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] PATH_INFO: `/v3/projects/ec30194cb60d4568af599640621c8d1b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.109816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec30194cb60d4568af599640621c8d1b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.112053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.114803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1011/1960] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:00.115462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.127776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df190-61aa-460f-9eed-0591896141e1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.133356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da292-cb30-4546-aac5-2d6c788b70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.134048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da292-cb30-4546-aac5-2d6c788b70c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.134365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da292-cb30-4546-aac5-2d6c788b70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.134887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da292-cb30-4546-aac5-2d6c788b70c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.135599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da292-cb30-4546-aac5-2d6c788b70c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.138614 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da292-cb30-4546-aac5-2d6c788b70c6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.279348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1012/1961] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:00 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:00.280751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.281121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.281481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.300440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:00.301534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.309223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec30194cb60d4568af599640621c8d1b', 'request_id': 'req-7cb56314-a369-46c2-b1e9-5060b712f017'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.315837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec30194cb60d4568af599640621c8d1b', 'request_id': 'req-7cb56314-a369-46c2-b1e9-5060b712f017'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.323427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec30194cb60d4568af599640621c8d1b', 'request_id': 'req-7cb56314-a369-46c2-b1e9-5060b712f017'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.369517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1013/1962] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:00.370261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.379910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb43f-2f8f-4c40-83c5-c54cd97bc175 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.385286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.387121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.387121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.387121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.387379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.388936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.400698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1014/1963] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:00.400698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.409372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecc5a2-231e-44e4-a50f-7d7d79b87c1c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.414037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.414662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.414948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.415228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.415933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.417484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.419757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] The token cache is being invalidate because project ec30194cb60d4568af599640621c8d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:00.423737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.423737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.423737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 950/1964] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:59 2022] DELETE /identity/v3/projects/ec30194cb60d4568af599640621c8d1b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:00.423737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.424762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.432682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1015/1965] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:00.432682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.432682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.438148 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb56314-a369-46c2-b1e9-5060b712f017 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.442798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.444024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.444598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.445136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.445504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291f60-e4df-4cf9-9b02-355b93d8de4c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.446363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:00.446783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.448399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.450260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.451131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.451423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.452478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] PATH_INFO: `/v3/projects/a72f72de76ec44679aa5c2917b704356/users/af66f77d9a3645d79c801a2224e92628/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.460751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 951/1966] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:00.461599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.463324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.468397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72f72de76ec44679aa5c2917b704356, user_id=af66f77d9a3645d79c801a2224e92628, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.471238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.482756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82686d92-40b2-4b7c-95d9-615f2088eaae admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.487472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.488335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.488609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.488877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] PATH_INFO: `/v3/users/6d26ea1825c34e919ad7c3dad6e97037` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.490637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d26ea1825c34e919ad7c3dad6e97037)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.492557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.593427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1016/1967] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:00 2022] PUT /identity/v3/projects/a72f72de76ec44679aa5c2917b704356/users/af66f77d9a3645d79c801a2224e92628/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:00.593427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.593427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.663583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bd1d4-4d2b-4926-b8da-b7600af7db05 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.668557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.669460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.669748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.670132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] PATH_INFO: `/v3/projects/c49ddf66a6a7421f8559701266ebca31/users/72e1c6643eae4015a2faddf1d7228128/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.687133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49ddf66a6a7421f8559701266ebca31, user_id=72e1c6643eae4015a2faddf1d7228128, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.689971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.747853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:00.751119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d26ea1825c34e919ad7c3dad6e97037'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.762782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d26ea1825c34e919ad7c3dad6e97037'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.805431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1017/1968] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:00 2022] PUT /identity/v3/projects/c49ddf66a6a7421f8559701266ebca31/users/72e1c6643eae4015a2faddf1d7228128/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:00.806290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.827173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d26ea1825c34e919ad7c3dad6e97037'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.834869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d26ea1825c34e919ad7c3dad6e97037'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.835562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f1c2b60b-18d8-45a5-9b7a-146451eb3894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d26ea1825c34e919ad7c3dad6e97037'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:00.845016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 952/1969] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:00 2022] DELETE /identity/v3/users/6d26ea1825c34e919ad7c3dad6e97037 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:00.845016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.845016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.845016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.878142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] MFA Rules not processed for user `af66f77d9a3645d79c801a2224e92628`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:00.879945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.899206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c856-aa50-4f3e-abb8-184e500166a9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.967880 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 953/1970] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:00.968461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.971692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.971692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.971692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.972034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:00.972123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.972227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:00.973491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:00.987080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018754ef-6bb0-4fda-92d7-2a8fbc381b02 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:00.993642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:00.994365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:00.994694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:00.994968 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:00.995750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:00.997363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.009435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 954/1971] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:01.011836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.011836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.028859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a41f1-718f-4e1f-96ab-df6e3d8cd313 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.038672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.039380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.039662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.039935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.040690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.042801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.068854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1018/1972] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:00 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:01.069639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.133104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66a2e-b596-4986-b891-4145b6889d26 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.138021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.138923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.139209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.139488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] PATH_INFO: `/v3/projects/c49ddf66a6a7421f8559701266ebca31/users/72e1c6643eae4015a2faddf1d7228128/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.141503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49ddf66a6a7421f8559701266ebca31, user_id=72e1c6643eae4015a2faddf1d7228128, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.144333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.159899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 955/1973] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:01 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:01.160089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1019/1974] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:01 2022] PUT /identity/v3/projects/c49ddf66a6a7421f8559701266ebca31/users/72e1c6643eae4015a2faddf1d7228128/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:01.160184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.161656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.161776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.254977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b88ee-987a-4ade-9c5b-3e49d17c7eb7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.261117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093abbfa-3195-4921-b2e6-2ffd596ce36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.261969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98bb45-cb6b-4bbe-ab93-7cb7a4a9f28a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.263203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093abbfa-3195-4921-b2e6-2ffd596ce36f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.263466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093abbfa-3195-4921-b2e6-2ffd596ce36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.263753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093abbfa-3195-4921-b2e6-2ffd596ce36f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.264501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093abbfa-3195-4921-b2e6-2ffd596ce36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.267204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093abbfa-3195-4921-b2e6-2ffd596ce36f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.270238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.270608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.270964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.272120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.272747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.274823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.400465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1020/1975] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:01 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:01.400975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 956/1976] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:01 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:01.401825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.402184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.402494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.404443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.415595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d1e59-fb2a-4a54-857e-4bc70aaa85e5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.421786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.422483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.422767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.423044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.423840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.425447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.431632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] MFA Rules not processed for user `72e1c6643eae4015a2faddf1d7228128`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:01.432942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.440473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 957/1977] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:01.440473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.466019 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4377e-d164-4716-b588-de2d48fb474b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.472013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.472803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.472985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.473290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.474060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.476538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.489093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 958/1978] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:01.489437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.491244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.506571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d2ece-c5dc-4234-b4b7-269b47677c5a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.517555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.518605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.518890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.519250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] PATH_INFO: `/v3/projects/faf34adf0405430c8063ee793da36f2c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.520543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf34adf0405430c8063ee793da36f2c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.523366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.536231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1021/1979] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:01.537106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.551689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76eaf3-e510-4b35-ab30-a5eaf3179fdb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.556382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.557671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.558045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.558418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] PATH_INFO: `/v3/projects/279c6359972d47a2ac12eab96552ddc0/users/1c481bec05bb441298044f8aa416e919/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.574553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279c6359972d47a2ac12eab96552ddc0, user_id=1c481bec05bb441298044f8aa416e919, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.577203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.668678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:01.673003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1022/1980] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:01 2022] PUT /identity/v3/projects/279c6359972d47a2ac12eab96552ddc0/users/1c481bec05bb441298044f8aa416e919/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:01.675987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.684145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf34adf0405430c8063ee793da36f2c', 'request_id': 'req-9209c078-11a2-4630-8a93-f56658304c2a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:01.690665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf34adf0405430c8063ee793da36f2c', 'request_id': 'req-9209c078-11a2-4630-8a93-f56658304c2a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:01.697128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf34adf0405430c8063ee793da36f2c', 'request_id': 'req-9209c078-11a2-4630-8a93-f56658304c2a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:01.736980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe3aa-5d39-4798-9886-5fda661c5cc9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.798625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.799312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.799604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.799889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.800633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.802282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.810429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] The token cache is being invalidate because project faf34adf0405430c8063ee793da36f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:01.810961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:01.816605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1023/1981] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:01.816722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:01.816819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.818095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 959/1982] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:01 2022] DELETE /identity/v3/projects/faf34adf0405430c8063ee793da36f2c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:01.818254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.819397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.822731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.848515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209c078-11a2-4630-8a93-f56658304c2a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.860274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.860960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.861249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.861527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.862299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:01.863934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:01.882168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932dac-e5b0-406b-a9de-c913dc955cf3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.889140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.889766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.893680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 960/1983] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:01.893680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:01.894188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.894188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.901112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.905933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:01.941088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0e71-1861-4dae-9f2b-f631bc8da65e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:01.956167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ee88-5448-4528-a7d7-89e7a11d531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:01.958642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ee88-5448-4528-a7d7-89e7a11d531d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:01.958965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ee88-5448-4528-a7d7-89e7a11d531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:01.959253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ee88-5448-4528-a7d7-89e7a11d531d admin admin] PATH_INFO: `/v3/projects/417f18706c5f46fa8e6e9303d78a5270/users/14c2924c042f455a860b7a6b2e131e25/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:01.998790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997ee88-5448-4528-a7d7-89e7a11d531d admin admin] RBAC: Authorizing `identity:create_grant(project_id=417f18706c5f46fa8e6e9303d78a5270, user_id=14c2924c042f455a860b7a6b2e131e25, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.001607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997ee88-5448-4528-a7d7-89e7a11d531d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.019001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.020504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32670fcf-7fcf-4322-bf3d-3f329ac59188 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.030056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1024/1984] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:02.031305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.031763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.031877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.051533 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:02.053490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:02.062128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1025/1985] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:02.072377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.082791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 961/1986] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:01 2022] PUT /identity/v3/projects/417f18706c5f46fa8e6e9303d78a5270/users/14c2924c042f455a860b7a6b2e131e25/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:02.084200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6042ab-523a-49a7-b4d3-11d87e09fb8d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.084802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b831c-c738-44df-b4df-79006467524b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.085290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b831c-c738-44df-b4df-79006467524b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.085778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b831c-c738-44df-b4df-79006467524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.125922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-473b831c-c738-44df-b4df-79006467524b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:02.127202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-473b831c-c738-44df-b4df-79006467524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:02.171384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.172210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.172500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.172791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] PATH_INFO: `/v3/projects/279c6359972d47a2ac12eab96552ddc0/users/1c481bec05bb441298044f8aa416e919/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.180141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] RBAC: Authorizing `identity:create_grant(project_id=279c6359972d47a2ac12eab96552ddc0, user_id=1c481bec05bb441298044f8aa416e919, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.188457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.202162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 962/1987] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:02.203590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.203878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.204156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.210142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1026/1988] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:02 2022] PUT /identity/v3/projects/279c6359972d47a2ac12eab96552ddc0/users/1c481bec05bb441298044f8aa416e919/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:02.210142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.216784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:02.238449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] MFA Rules not processed for user `14c2924c042f455a860b7a6b2e131e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:02.242088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:02.289616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f848f5-eb27-4490-be01-3d29b793521a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.293309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.293983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.294317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.294620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.296392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:02.311612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:02.322532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 963/1989] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:02.323398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.368127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.369667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea86aa-ee11-466e-8b9a-4fecd5fb2a2d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.380789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1027/1990] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:02.381904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.382232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.382540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.392385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849a7e-0985-4d51-87c0-3db92fa9b763 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.404227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.404922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.405209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.405490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.406271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:02.406720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.409324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.416148 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:02.420908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] MFA Rules not processed for user `1c481bec05bb441298044f8aa416e919`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:02.429040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:02.433710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 964/1991] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:02.434597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.450373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711af8-05d1-4593-9517-0035ed61556e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.457098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.457098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.457098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.457098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.457954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.460157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.526253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1028/1992] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:02.526253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.537292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd233-f9ea-4621-83a7-773770ca4fe8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.543972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.544692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.545146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.545431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.547047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.549339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.562278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 965/1993] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:02.566742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.643989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29260-adbf-452f-86d9-f8f67d6e57d0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.649701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.654549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.654759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1029/1994] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:02.654759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.663498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.663795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.748388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84d17-768f-4e71-a992-3f171db94c04 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.754887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.755568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.756066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.756363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.757143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.757308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.758182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.760317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.769647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 966/1995] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:02.770577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.853503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c98e72-ddd7-468d-a789-c83bf1d8780e service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.855446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1030/1996] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:02.856498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.862687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.864111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.864408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.864696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.866198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.868012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94beeab-4fba-4244-b8b6-943ce57d49d9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.868864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.873214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.873943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.874288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.874593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.875310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.877941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.890041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1031/1997] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:02.894135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.915265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85576-856d-4183-8b32-11dfaa8a788d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:02.921852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:02.923396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:02.938383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:02.938746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] PATH_INFO: `/v3/projects/3368a8bafb4d46db8d0bf37489848412/users/66aa2ccdca7e49a2995e894e95ff3744/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:02.966047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3368a8bafb4d46db8d0bf37489848412, user_id=66aa2ccdca7e49a2995e894e95ff3744, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:02.968882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:02.985735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 967/1998] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:02 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:02.986866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:02.998236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a99959-7cc9-499c-be2f-25a6d209cefe admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.003302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.004053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.004402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.004745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.005817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.007384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.027088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 968/1999] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:03.031445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.041458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d320ff-aa23-4b3d-8c4c-0e75cc3b8ceb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.048360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.049023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.049389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.053258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.053258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.053258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.065089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 969/2000] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:03.069860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.082655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778739-b9d3-414b-ad59-2129eb5e6cb5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.086091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1032/2001] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:02 2022] PUT /identity/v3/projects/3368a8bafb4d46db8d0bf37489848412/users/66aa2ccdca7e49a2995e894e95ff3744/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:03.090151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.176698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f39a-ffb7-4cfe-8560-dd7410fe5639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.178458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f39a-ffb7-4cfe-8560-dd7410fe5639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.178818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f39a-ffb7-4cfe-8560-dd7410fe5639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.180000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f39a-ffb7-4cfe-8560-dd7410fe5639 admin admin] PATH_INFO: `/v3/projects/e5938407c1c84f78b54055bc5d877982/users/e69e5ea7e1da4f5494f36fe300de679b/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.204625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f39a-ffb7-4cfe-8560-dd7410fe5639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5938407c1c84f78b54055bc5d877982, user_id=e69e5ea7e1da4f5494f36fe300de679b, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.208640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f39a-ffb7-4cfe-8560-dd7410fe5639 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.210988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:03.251156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6628d8-ba3e-4ae8-aaca-fe80d380f1ad admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.257480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.259268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.259568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.259901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.260708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.262402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.278322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1033/2002] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:03.280223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.292093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fabe57-70fb-41a9-8de9-2be26ebacf3b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.297319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08034e-b178-4dda-925f-4427879f18cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.298292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08034e-b178-4dda-925f-4427879f18cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.298740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08034e-b178-4dda-925f-4427879f18cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.299038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08034e-b178-4dda-925f-4427879f18cd admin admin] PATH_INFO: `/v3/projects/3368a8bafb4d46db8d0bf37489848412/users/66aa2ccdca7e49a2995e894e95ff3744/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.313584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08034e-b178-4dda-925f-4427879f18cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3368a8bafb4d46db8d0bf37489848412, user_id=66aa2ccdca7e49a2995e894e95ff3744, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.320098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08034e-b178-4dda-925f-4427879f18cd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.360622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 970/2003] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:03 2022] PUT /identity/v3/projects/e5938407c1c84f78b54055bc5d877982/users/e69e5ea7e1da4f5494f36fe300de679b/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:03.369743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1034/2004] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:03 2022] PUT /identity/v3/projects/3368a8bafb4d46db8d0bf37489848412/users/66aa2ccdca7e49a2995e894e95ff3744/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:03.371696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c625-605e-4751-91b8-15145922065b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.371997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c625-605e-4751-91b8-15145922065b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.372275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c625-605e-4751-91b8-15145922065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.373104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.373489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.374486 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.416279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] MFA Rules not processed for user `e69e5ea7e1da4f5494f36fe300de679b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:03.417813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:03.418532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0f44c625-605e-4751-91b8-15145922065b None None] MFA Rules not processed for user `66aa2ccdca7e49a2995e894e95ff3744`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:03.419903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0f44c625-605e-4751-91b8-15145922065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:03.493708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1035/2005] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:03.498365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.503118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 971/2006] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:03.503789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c625-605e-4751-91b8-15145922065b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.561221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71649293-b3fd-4b87-9c5d-a2d3ce3793a3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.565746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f110-160f-475f-9081-534facf66965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.565892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f110-160f-475f-9081-534facf66965 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.566273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f110-160f-475f-9081-534facf66965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.566620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f110-160f-475f-9081-534facf66965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.569331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7957f110-160f-475f-9081-534facf66965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:03.578273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c625-605e-4751-91b8-15145922065b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.584844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.585910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.586550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.587017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.587898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.590455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.637579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f110-160f-475f-9081-534facf66965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.639436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f110-160f-475f-9081-534facf66965 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.650405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1036/2007] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:03.654146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f110-160f-475f-9081-534facf66965 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.660408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f110-160f-475f-9081-534facf66965 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.664516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.665310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.665591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.665864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.677685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.680492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.702581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1037/2008] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:03.721247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 972/2009] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:03 2022] POST /identity/v3/projects => generated 389 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:03.725493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.746353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5189f-9818-411a-bdbe-5e8789471d32 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.837701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.841158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.842295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.842410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.842791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.843569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:03.845597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:03.925933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377582-0d9e-4a35-a2e3-c5ca6c968ab7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:03.931403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:03.932476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:03.934313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:03.934786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:03.977924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1038/2010] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:03 2022] POST /identity/v3/users => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:03.981806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:03.994208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3521c3f-f707-4d8b-936c-4af3863d00c8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:04.000783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:04.001577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.001959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.002337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.003157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:04.004887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:04.021179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1039/2011] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:04.024737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:04.030436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:04.032035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:04.041297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c97ce2-ef38-45a5-afcd-f8402517f663 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:04.043253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 973/2012] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:04.055636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:04.056553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.057209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.058594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] PATH_INFO: `/v3/projects/b75bea49866d48b28508978279aa4684/users/bff792759f2e44f8a7d204fd3d016c3c/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.080077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75bea49866d48b28508978279aa4684, user_id=bff792759f2e44f8a7d204fd3d016c3c, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:04.084046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:04.214028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1040/2013] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:04 2022] PUT /identity/v3/projects/b75bea49866d48b28508978279aa4684/users/bff792759f2e44f8a7d204fd3d016c3c/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:04.218168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:04.233009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18e242-2d65-42e0-91a9-cb4247be7e0f service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:04.263841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:04.297514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:04.320425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:04.321741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.322071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.322626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.323272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:04.325916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:04.356498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 974/2014] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:04.358125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:04.384418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862835df-5ce2-4a7d-9f91-d776ddab494f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:04.392243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff2020-33ba-4f1a-bea8-ca05af115321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:04.392417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7aef-2dde-40f1-b8e8-b83bba10eb8f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:04.393261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff2020-33ba-4f1a-bea8-ca05af115321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.393620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff2020-33ba-4f1a-bea8-ca05af115321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.393986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff2020-33ba-4f1a-bea8-ca05af115321 admin admin] PATH_INFO: `/v3/projects/b75bea49866d48b28508978279aa4684/users/bff792759f2e44f8a7d204fd3d016c3c/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.396471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff2020-33ba-4f1a-bea8-ca05af115321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75bea49866d48b28508978279aa4684, user_id=bff792759f2e44f8a7d204fd3d016c3c, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:04.397657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:04.398585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.398870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.399165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] PATH_INFO: `/v3/users/af66f77d9a3645d79c801a2224e92628` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.399496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff2020-33ba-4f1a-bea8-ca05af115321 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:04.400371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af66f77d9a3645d79c801a2224e92628)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:04.402336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:04.414188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 975/2015] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:04 2022] PUT /identity/v3/projects/b75bea49866d48b28508978279aa4684/users/bff792759f2e44f8a7d204fd3d016c3c/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:04.423885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749addd-d794-4f43-8fb9-cffeeb86ad30 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.424397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749addd-d794-4f43-8fb9-cffeeb86ad30 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.425149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749addd-d794-4f43-8fb9-cffeeb86ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.458563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f749addd-d794-4f43-8fb9-cffeeb86ad30 None None] MFA Rules not processed for user `bff792759f2e44f8a7d204fd3d016c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:04.460578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f749addd-d794-4f43-8fb9-cffeeb86ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:04.543438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 976/2016] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:04.628449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af66f77d9a3645d79c801a2224e92628'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:04.629175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af66f77d9a3645d79c801a2224e92628'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:04.654694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af66f77d9a3645d79c801a2224e92628'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:04.663253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af66f77d9a3645d79c801a2224e92628'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:04.735826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af66f77d9a3645d79c801a2224e92628'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:04.745873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1041/2017] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:04 2022] DELETE /identity/v3/users/af66f77d9a3645d79c801a2224e92628 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:04.748348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.748838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.750298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.767292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:04.770628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:04.782168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:04.783364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:04.834726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:04.911728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19cb74-e287-4c9b-8850-bef77769b98e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:04.916669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:04.918590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:04.919001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:04.919443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:04.922933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:04.975470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 977/2018] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:04.996306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:04.996306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:05.020285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:05.024200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:05.036354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1042/2019] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:05.088175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fcc8e-4479-46e2-a9b2-201a8c212651 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:05.092601 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e3f15-8804-41e4-bec8-fa94d169fd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:05.093531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e3f15-8804-41e4-bec8-fa94d169fd71 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:05.094079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e3f15-8804-41e4-bec8-fa94d169fd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:05.094465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e3f15-8804-41e4-bec8-fa94d169fd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:05.105798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e3f15-8804-41e4-bec8-fa94d169fd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:05.108338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e3f15-8804-41e4-bec8-fa94d169fd71 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:05.144291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 978/2020] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:05.371268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:05.373247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:05.395423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc7b4c-1fcb-41ce-a75b-535ef5269046 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:05.411171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:05.411681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:05.412019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:05.412301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] PATH_INFO: `/v3/users/e69e5ea7e1da4f5494f36fe300de679b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:05.413805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69e5ea7e1da4f5494f36fe300de679b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:05.419677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:05.721940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69e5ea7e1da4f5494f36fe300de679b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:05.723805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69e5ea7e1da4f5494f36fe300de679b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:05.759184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69e5ea7e1da4f5494f36fe300de679b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:05.780476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69e5ea7e1da4f5494f36fe300de679b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:05.867675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69e5ea7e1da4f5494f36fe300de679b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:05.883152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1043/2021] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:05 2022] DELETE /identity/v3/users/e69e5ea7e1da4f5494f36fe300de679b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:05.884969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:05.885269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:05.885557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:05.916007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:05.917293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:05.997653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:05.999315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:06.021652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 979/2022] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:06.039113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:06.040545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:06.142659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de4d1-6a05-4ffd-ac35-464e3e554922 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:06.159419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:06.160313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:06.160614 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:06.160886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] PATH_INFO: `/v3/projects/a72f72de76ec44679aa5c2917b704356` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:06.163130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72f72de76ec44679aa5c2917b704356)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:06.165132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:06.171587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb18378-4927-42cc-b900-f460b2e77e5b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:06.175734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:06.176294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:06.177137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:06.178129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:06.195787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:06.199353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:06.204037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:06.213041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 980/2023] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:06.411850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72f72de76ec44679aa5c2917b704356', 'request_id': 'req-c358b431-7831-450c-96e2-1ae73f7e9448'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:06.496499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72f72de76ec44679aa5c2917b704356', 'request_id': 'req-c358b431-7831-450c-96e2-1ae73f7e9448'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:06.506410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72f72de76ec44679aa5c2917b704356', 'request_id': 'req-c358b431-7831-450c-96e2-1ae73f7e9448'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:06.553102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] The token cache is being invalidate because project a72f72de76ec44679aa5c2917b704356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:06.553398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:06.554790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:06.558636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1044/2024] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:05 2022] DELETE /identity/v3/projects/a72f72de76ec44679aa5c2917b704356 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:06.563195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:06.581066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c978-d191-4cad-8240-d450b09ff2f4 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:06.712309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:06.713366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:06.713757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:06.714169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] PATH_INFO: `/v3/users/1c481bec05bb441298044f8aa416e919` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:06.715610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c481bec05bb441298044f8aa416e919)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:06.718179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:06.874280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:06.926701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:06.928762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:06.947743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b431-7831-450c-96e2-1ae73f7e9448 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:06.957406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:06.959318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:06.959473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:06.960541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] PATH_INFO: `/v3/projects/e5938407c1c84f78b54055bc5d877982` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:06.968805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5938407c1c84f78b54055bc5d877982)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:06.970846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:06.972441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c481bec05bb441298044f8aa416e919'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.000271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c481bec05bb441298044f8aa416e919'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.122021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c481bec05bb441298044f8aa416e919'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.133206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c481bec05bb441298044f8aa416e919'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.134062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c481bec05bb441298044f8aa416e919'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.141493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 981/2025] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:06 2022] DELETE /identity/v3/users/1c481bec05bb441298044f8aa416e919 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:07.147542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5938407c1c84f78b54055bc5d877982', 'request_id': 'req-5c6cedf1-020e-4b05-85ee-07bf98c41e01'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.244571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5938407c1c84f78b54055bc5d877982', 'request_id': 'req-5c6cedf1-020e-4b05-85ee-07bf98c41e01'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.253403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5938407c1c84f78b54055bc5d877982', 'request_id': 'req-5c6cedf1-020e-4b05-85ee-07bf98c41e01'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.270369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] The token cache is being invalidate because project e5938407c1c84f78b54055bc5d877982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:07.270515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.273095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.276359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1045/2026] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:06 2022] DELETE /identity/v3/projects/e5938407c1c84f78b54055bc5d877982 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:07.280286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:07.281714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:07.446344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77272ea-b4f5-4aa1-b5f0-86e401546b8d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:07.454499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:07.455392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:07.455672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:07.455947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] PATH_INFO: `/v3/users/bff792759f2e44f8a7d204fd3d016c3c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:07.457222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff792759f2e44f8a7d204fd3d016c3c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:07.459196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:07.734829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff792759f2e44f8a7d204fd3d016c3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.760693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff792759f2e44f8a7d204fd3d016c3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.844231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff792759f2e44f8a7d204fd3d016c3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.861076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff792759f2e44f8a7d204fd3d016c3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.862011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff792759f2e44f8a7d204fd3d016c3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:07.890918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 982/2027] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:07 2022] DELETE /identity/v3/users/bff792759f2e44f8a7d204fd3d016c3c => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:08.130011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:08.131759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:08.237743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cedf1-020e-4b05-85ee-07bf98c41e01 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:08.303205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:08.304489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:08.304914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:08.305411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] PATH_INFO: `/v3/projects/279c6359972d47a2ac12eab96552ddc0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:08.307185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279c6359972d47a2ac12eab96552ddc0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:08.309606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:08.320892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:08.323075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:08.347157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69136da-6ede-4d12-9f2e-98c24c1a13b4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:08.363251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:08.366737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:08.368416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:08.368859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] PATH_INFO: `/v3/users/c8daff2d40fb41b182fb0a4e2b59e735` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:08.374599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8daff2d40fb41b182fb0a4e2b59e735)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:08.378963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:08.390857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:08.486603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279c6359972d47a2ac12eab96552ddc0', 'request_id': 'req-07d1fe9d-4551-496d-93ca-6ac784033621'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.587869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279c6359972d47a2ac12eab96552ddc0', 'request_id': 'req-07d1fe9d-4551-496d-93ca-6ac784033621'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.595381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279c6359972d47a2ac12eab96552ddc0', 'request_id': 'req-07d1fe9d-4551-496d-93ca-6ac784033621'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.607180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] The token cache is being invalidate because project 279c6359972d47a2ac12eab96552ddc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:08.607654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.608596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.610574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1046/2028] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:08 2022] DELETE /identity/v3/projects/279c6359972d47a2ac12eab96552ddc0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:08.611645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:08.612967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:08.635918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8daff2d40fb41b182fb0a4e2b59e735'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.657428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8daff2d40fb41b182fb0a4e2b59e735'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.713605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fe9d-4551-496d-93ca-6ac784033621 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:08.718840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:08.719769 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:08.720052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:08.720335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] PATH_INFO: `/v3/users/14c2924c042f455a860b7a6b2e131e25` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:08.721571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c2924c042f455a860b7a6b2e131e25)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:08.723742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:08.764466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8daff2d40fb41b182fb0a4e2b59e735'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.774241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8daff2d40fb41b182fb0a4e2b59e735'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.775248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b98b1efa-afff-4dce-8551-62e07fd6d082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8daff2d40fb41b182fb0a4e2b59e735'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.784876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 983/2029] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:08 2022] DELETE /identity/v3/users/c8daff2d40fb41b182fb0a4e2b59e735 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:08.789686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed884-4dc0-4a9c-889f-cc422935cd5e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:08.790284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed884-4dc0-4a9c-889f-cc422935cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:08.790815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed884-4dc0-4a9c-889f-cc422935cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:08.825375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ec2ed884-4dc0-4a9c-889f-cc422935cd5e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:08.827847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ec2ed884-4dc0-4a9c-889f-cc422935cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:08.923272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 984/2030] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:08.923272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e74b0-7763-4b14-a359-e0580ac6a251 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:08.923272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e74b0-7763-4b14-a359-e0580ac6a251 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:08.923272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e74b0-7763-4b14-a359-e0580ac6a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:08.946633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b94e74b0-7763-4b14-a359-e0580ac6a251 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:08.947923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b94e74b0-7763-4b14-a359-e0580ac6a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:08.958218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 985/2031] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:08.961442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:08.961733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:08.962190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:08.980007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c2924c042f455a860b7a6b2e131e25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.980737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c2924c042f455a860b7a6b2e131e25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:08.988589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:08.989896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:08.999206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 986/2032] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:08.999863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.000983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c2924c042f455a860b7a6b2e131e25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.001208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.008369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c2924c042f455a860b7a6b2e131e25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.066213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49d68f-97c9-4367-bb46-0e217c9b73f6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.075694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.076594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.077038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.077664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.080075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.091305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c2924c042f455a860b7a6b2e131e25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.093888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:09.100810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.102591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.127818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1047/2033] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:08 2022] DELETE /identity/v3/users/14c2924c042f455a860b7a6b2e131e25 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:09.129610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.156177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 987/2034] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:09.160084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.161613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.192772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960df6-4a74-4f07-a4bb-1f2bfe282478 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.225937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76771-7e25-47ba-8ac6-cae8058aa5cb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.240200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.242425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.242955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.244023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.244987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:09.246612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.248534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af706d-c744-4559-bfa2-0104525eb539 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.276817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1048/2035] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:09.278555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.279481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.282390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.316534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.317814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.318401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.319317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] PATH_INFO: `/v3/projects/b75bea49866d48b28508978279aa4684` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.321105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:09.322027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75bea49866d48b28508978279aa4684)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.323809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.327358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.337569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1049/2036] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:09.338768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.370359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def81b-bfb1-401a-a746-001c4a4338f2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.376539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.377209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.377494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.377771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.379132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.381581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.492776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1050/2037] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:09 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:09.493576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.498890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.503654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75bea49866d48b28508978279aa4684', 'request_id': 'req-d5403f7b-093f-4a51-b1a5-86f08f89363b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.512705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75bea49866d48b28508978279aa4684', 'request_id': 'req-d5403f7b-093f-4a51-b1a5-86f08f89363b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.520259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75bea49866d48b28508978279aa4684', 'request_id': 'req-d5403f7b-093f-4a51-b1a5-86f08f89363b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.600969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee738ca-d173-49d9-9c2e-d6436d6ef181 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.605452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b9bc-40d4-4fd3-bcd5-49714873d101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.605954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b9bc-40d4-4fd3-bcd5-49714873d101 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.606274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b9bc-40d4-4fd3-bcd5-49714873d101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.606643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b9bc-40d4-4fd3-bcd5-49714873d101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.630067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] The token cache is being invalidate because project b75bea49866d48b28508978279aa4684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:09.630067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.631034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:09.636857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 988/2038] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:09 2022] DELETE /identity/v3/projects/b75bea49866d48b28508978279aa4684 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:09.636857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.638482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.705458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b9bc-40d4-4fd3-bcd5-49714873d101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.708688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b9bc-40d4-4fd3-bcd5-49714873d101 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.735692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1051/2039] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:09.737897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.739074 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.739634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.747826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403f7b-093f-4a51-b1a5-86f08f89363b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.761925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57adce-e79e-4ed8-ae99-7a6501c7a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.763103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57adce-e79e-4ed8-ae99-7a6501c7a7ae admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.773960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57adce-e79e-4ed8-ae99-7a6501c7a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.775313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57adce-e79e-4ed8-ae99-7a6501c7a7ae admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.776181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57adce-e79e-4ed8-ae99-7a6501c7a7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.779902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57adce-e79e-4ed8-ae99-7a6501c7a7ae admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.789625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:09.793008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.843784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1052/2040] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:09.843784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.843784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.858315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203153-4ec3-4364-9b30-70f3b714fb49 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.863171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.864055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.870725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.870725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] PATH_INFO: `/v3/projects/f048dbfd6eb640d69a24d1f7d8130fd8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.870725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f048dbfd6eb640d69a24d1f7d8130fd8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.870725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.943840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 989/2041] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:09 2022] POST /identity/v3/users => generated 286 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:09.945380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.945705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.946010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.968340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:09.969894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.984437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 990/2042] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:09.985379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.997312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0a6e-b821-4cd5-abe5-ea52df08abdf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.004700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.005326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.006226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.006506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.007241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.008927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.022402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 991/2043] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:10.022925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.036190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1817-951b-44e0-8647-bf8690849b1d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.054509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.058949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.059235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.059517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.060420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:10.060738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.061967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f048dbfd6eb640d69a24d1f7d8130fd8', 'request_id': 'req-872ce012-285d-4355-8a0f-bb161d5f6d30'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.063263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.086043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 992/2044] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:10.086934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.108583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16acebf-2fcd-49b3-964f-ba10e515a1b0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.159191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f048dbfd6eb640d69a24d1f7d8130fd8', 'request_id': 'req-872ce012-285d-4355-8a0f-bb161d5f6d30'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.168559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f048dbfd6eb640d69a24d1f7d8130fd8', 'request_id': 'req-872ce012-285d-4355-8a0f-bb161d5f6d30'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.189594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] The token cache is being invalidate because project f048dbfd6eb640d69a24d1f7d8130fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:10.189895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.191316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.194034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1053/2045] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:09 2022] DELETE /identity/v3/projects/f048dbfd6eb640d69a24d1f7d8130fd8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:10.199277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.201549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.207208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.208145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.208532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.208845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.209586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.211361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.220852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce012-285d-4355-8a0f-bb161d5f6d30 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.227390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.228066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.228400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.229277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.230063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.231632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 993/2046] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:10.237934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.240897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.240897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.256696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c12fb5-15bc-49d2-a399-a522e1f901d0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.262971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.264011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.264124 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.264486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] PATH_INFO: `/v3/users/72e1c6643eae4015a2faddf1d7228128` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.265676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e1c6643eae4015a2faddf1d7228128)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.270398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.362430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1054/2047] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:10 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:10.362430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.362430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.447764 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbdd1-4497-491c-8aed-c8f3e54378ca admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.455173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.456615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.459579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.459579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] PATH_INFO: `/v3/projects/272b8346885e4beba4f663fa6a5e1cb6/users/5bc7904541d346f79e35c648ec920c43/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.476335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=272b8346885e4beba4f663fa6a5e1cb6, user_id=5bc7904541d346f79e35c648ec920c43, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.479305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.544713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e1c6643eae4015a2faddf1d7228128'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.567815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1055/2048] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:10 2022] PUT /identity/v3/projects/272b8346885e4beba4f663fa6a5e1cb6/users/5bc7904541d346f79e35c648ec920c43/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:10.567960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e1c6643eae4015a2faddf1d7228128'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.569071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.643103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935052-e5ca-46e0-82b1-3b88329a9d0a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.650792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc66f1f-c47b-4e08-8f34-2159350dde66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.650792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc66f1f-c47b-4e08-8f34-2159350dde66 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.650792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc66f1f-c47b-4e08-8f34-2159350dde66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.650792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc66f1f-c47b-4e08-8f34-2159350dde66 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.651107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc66f1f-c47b-4e08-8f34-2159350dde66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.651855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc66f1f-c47b-4e08-8f34-2159350dde66 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.744940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e1c6643eae4015a2faddf1d7228128'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.752973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e1c6643eae4015a2faddf1d7228128'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.753716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e1c6643eae4015a2faddf1d7228128'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:10.760135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 994/2049] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:10 2022] DELETE /identity/v3/users/72e1c6643eae4015a2faddf1d7228128 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:10.761001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.762451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.791941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1056/2050] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:10 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:10.791941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.791941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.791941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.819643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:10.821181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.878252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcbca0-d0b9-490d-af50-2653d5a4e195 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.887815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.889664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.890027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.890325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] PATH_INFO: `/v3/projects/417f18706c5f46fa8e6e9303d78a5270` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.892245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=417f18706c5f46fa8e6e9303d78a5270)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.899466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.910138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1057/2051] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:10.910993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.912370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.930037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00daf99-9ee4-4c0f-9047-347964a42e36 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.935210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.935774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.936063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.936344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.937240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.938921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.949765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1058/2052] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:10.950678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.952400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.031532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33818-ac99-444a-8cd6-ca2b4f649906 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.035880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.036128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.036373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.038038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.047394 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.048979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.061575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1059/2053] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:11.071851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.085828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2f05-448a-4bd2-8aba-ea9705052faa service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.090305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417f18706c5f46fa8e6e9303d78a5270', 'request_id': 'req-cfff3386-f3d4-463e-9a4e-2da104888ebf'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.101584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417f18706c5f46fa8e6e9303d78a5270', 'request_id': 'req-cfff3386-f3d4-463e-9a4e-2da104888ebf'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.106364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417f18706c5f46fa8e6e9303d78a5270', 'request_id': 'req-cfff3386-f3d4-463e-9a4e-2da104888ebf'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.147790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:11.160244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.160991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.161348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.162303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.163549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.165263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.169753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] The token cache is being invalidate because project 417f18706c5f46fa8e6e9303d78a5270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:11.170540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.170896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.172881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 995/2054] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:10 2022] DELETE /identity/v3/projects/417f18706c5f46fa8e6e9303d78a5270 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:11.181064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1060/2055] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:11.181247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.182639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.184062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.184531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.196933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f255ed-7f87-4bdb-90ad-8588fe664197 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.197074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3386-f3d4-463e-9a4e-2da104888ebf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.202015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.202141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.202419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.202593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.202721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.202884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.202993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] PATH_INFO: `/v3/projects/a24d934fb0b94eb4af2653452a8aba88/users/627e89ae45734ccd866a52dae23b912a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.203165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] PATH_INFO: `/v3/users/66aa2ccdca7e49a2995e894e95ff3744` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.204382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66aa2ccdca7e49a2995e894e95ff3744)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.206360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.217844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24d934fb0b94eb4af2653452a8aba88, user_id=627e89ae45734ccd866a52dae23b912a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.220582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.354788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1061/2056] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:11 2022] PUT /identity/v3/projects/a24d934fb0b94eb4af2653452a8aba88/users/627e89ae45734ccd866a52dae23b912a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:11.354788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.354788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.413525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9f15-d8d8-4d05-b30d-42f8c09abd2d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.429786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.430832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.431252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.431526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] PATH_INFO: `/v3/projects/c49ddf66a6a7421f8559701266ebca31` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.433111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49ddf66a6a7421f8559701266ebca31)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.434534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66aa2ccdca7e49a2995e894e95ff3744'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.435479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.449777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66aa2ccdca7e49a2995e894e95ff3744'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.569842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66aa2ccdca7e49a2995e894e95ff3744'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.578864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66aa2ccdca7e49a2995e894e95ff3744'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.579546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1be1d50d-59a1-4917-a71d-021ebc7c87c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66aa2ccdca7e49a2995e894e95ff3744'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.586822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 996/2057] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:11 2022] DELETE /identity/v3/users/66aa2ccdca7e49a2995e894e95ff3744 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:11.588181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.588479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.588772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.588914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49ddf66a6a7421f8559701266ebca31', 'request_id': 'req-98419f8b-ddec-4cad-8f98-0b77936f0c6a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.618700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] MFA Rules not processed for user `627e89ae45734ccd866a52dae23b912a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:11.620217 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.685201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49ddf66a6a7421f8559701266ebca31', 'request_id': 'req-98419f8b-ddec-4cad-8f98-0b77936f0c6a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.690636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 997/2058] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:11.693721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49ddf66a6a7421f8559701266ebca31', 'request_id': 'req-98419f8b-ddec-4cad-8f98-0b77936f0c6a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.694991 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.696369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.706832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] The token cache is being invalidate because project c49ddf66a6a7421f8559701266ebca31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:11.707135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.707866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-98419f8b-ddec-4cad-8f98-0b77936f0c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:11.710332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1062/2059] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:11 2022] DELETE /identity/v3/projects/c49ddf66a6a7421f8559701266ebca31 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:11.715040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd648c-0769-445a-8a81-dc2a6cc88478 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.715414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd648c-0769-445a-8a81-dc2a6cc88478 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.715772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd648c-0769-445a-8a81-dc2a6cc88478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.735813 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a2fd648c-0769-445a-8a81-dc2a6cc88478 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:11.737250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a2fd648c-0769-445a-8a81-dc2a6cc88478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.767048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5871c5-8344-438a-844c-86dbc6b18f38 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.774998 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.776407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.776587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.776839 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.777709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.780814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.784457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:11.807556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1063/2060] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:11.816586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.816879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.817161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.836245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:11.837556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.845747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1064/2061] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:11.855575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.871601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20f8c-386c-4c16-8c30-8ef00db2fe24 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.877660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.878414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.878705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.879278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.879739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:11.880056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.882311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.893776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 998/2062] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:11 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:11.896959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1065/2063] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:11.898470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.900382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:11.906151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:11.915936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd450ac-6253-40ed-a5a0-ea35482d7b27 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.975141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce061c7-9f8e-4177-924b-0b703ce1fd02 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:11.980740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.981785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.981785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.981922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.985758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.985758 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:11.990752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:11.992626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:11.993550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:11.994157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:11.995477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:11.999223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.129744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 999/2064] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:11 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:12.131836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1066/2065] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:11 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:12.132141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.132956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.134646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.149281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a86af-28ce-4db0-a349-a8471110938c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.206952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd82f-31e1-4afa-b99f-05fec545c5e9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.212917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.213691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.214059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.214473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.215190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.217307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.226409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.227696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.228077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.228526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] PATH_INFO: `/v3/projects/3368a8bafb4d46db8d0bf37489848412` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.229918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3368a8bafb4d46db8d0bf37489848412)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.232009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.307530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1067/2066] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:12 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:12.308528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.318548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab123b3-4ee8-4b27-83da-4c3280f4afc8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.323220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.323849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.324130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.324405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.325119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.326742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.342625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1068/2067] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:12.343567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.351044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3368a8bafb4d46db8d0bf37489848412', 'request_id': 'req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:12.353561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00fd1-5256-4ceb-8822-1b2c0417eb8e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.358495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3368a8bafb4d46db8d0bf37489848412', 'request_id': 'req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:12.368920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3368a8bafb4d46db8d0bf37489848412', 'request_id': 'req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:12.412454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.413059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.413344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.413623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.414440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.416020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.425747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1069/2068] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:12.428337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.435841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] The token cache is being invalidate because project 3368a8bafb4d46db8d0bf37489848412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:12.436137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:12.436677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3c9e-25ac-403b-87ce-b9ef1b4ef198 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.436837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:12.438467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1000/2069] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:12 2022] DELETE /identity/v3/projects/3368a8bafb4d46db8d0bf37489848412 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:12.439800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.441121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.441466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614706b7-46d3-4e7e-88dd-43fbcb8d574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.442407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614706b7-46d3-4e7e-88dd-43fbcb8d574d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.442760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614706b7-46d3-4e7e-88dd-43fbcb8d574d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.442988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614706b7-46d3-4e7e-88dd-43fbcb8d574d admin admin] PATH_INFO: `/v3/projects/2768d8a47a574ae8b578ba6855b4c91e/users/d9a5178a6ef54207a5f0cc55cf8a4f17/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.454119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25da95e-ab79-40c3-9d2c-eaaf3e9a0614 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.459059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ab7aa-fdf0-4d17-83cd-0caa4970c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.459368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614706b7-46d3-4e7e-88dd-43fbcb8d574d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2768d8a47a574ae8b578ba6855b4c91e, user_id=d9a5178a6ef54207a5f0cc55cf8a4f17, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.459762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ab7aa-fdf0-4d17-83cd-0caa4970c01d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.460050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ab7aa-fdf0-4d17-83cd-0caa4970c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.460327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ab7aa-fdf0-4d17-83cd-0caa4970c01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.461047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ab7aa-fdf0-4d17-83cd-0caa4970c01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.462062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614706b7-46d3-4e7e-88dd-43fbcb8d574d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.462683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ab7aa-fdf0-4d17-83cd-0caa4970c01d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.473635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1001/2070] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:12.474895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.475184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.475461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.493337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:12.494576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.502870 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1002/2071] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:12.503749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.514148 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f45c27-487d-45f7-836f-2c76185db9c7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.521633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.521633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.521633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.521633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] PATH_INFO: `/v3/projects/e6c844a2727b41d38137c0108b54eb53/users/08f2ee76f3874a78a58b3ccd38eb0e17/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.536045 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c844a2727b41d38137c0108b54eb53, user_id=08f2ee76f3874a78a58b3ccd38eb0e17, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.539331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.570126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1070/2072] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:12 2022] PUT /identity/v3/projects/2768d8a47a574ae8b578ba6855b4c91e/users/d9a5178a6ef54207a5f0cc55cf8a4f17/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:12.571531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236684-c043-4ea6-846f-d8393c8be9b6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.571905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236684-c043-4ea6-846f-d8393c8be9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.572260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236684-c043-4ea6-846f-d8393c8be9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.590309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-80236684-c043-4ea6-846f-d8393c8be9b6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:12.591766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-80236684-c043-4ea6-846f-d8393c8be9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.646687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1003/2073] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:12 2022] PUT /identity/v3/projects/e6c844a2727b41d38137c0108b54eb53/users/08f2ee76f3874a78a58b3ccd38eb0e17/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:12.647733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.650271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.676577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1071/2074] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:12.682662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d33a-7e09-43f9-b442-6020f90101a6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.683760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d33a-7e09-43f9-b442-6020f90101a6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.684060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d33a-7e09-43f9-b442-6020f90101a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.720028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6264d33a-7e09-43f9-b442-6020f90101a6 None None] MFA Rules not processed for user `08f2ee76f3874a78a58b3ccd38eb0e17`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:12.721274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6264d33a-7e09-43f9-b442-6020f90101a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.737099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17539-34c6-4057-aba5-2a13d93f4952 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.743013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.743812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.744175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.744524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.745473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.747227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.765548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1004/2075] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:12.765548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.785405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112f463-30e9-4b89-bb61-2af317986f8e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.792632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.793414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.793864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.794294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.795126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:12.795674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.799348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.814745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1005/2076] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:12.815577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.826373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d2ceb-e86d-405d-9c90-e7a64f210d9a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.829461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1072/2077] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:12.831038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.831490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.831771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.832394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.842402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.842402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.842402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] PATH_INFO: `/v3/projects/2768d8a47a574ae8b578ba6855b4c91e/users/d9a5178a6ef54207a5f0cc55cf8a4f17/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.842402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2768d8a47a574ae8b578ba6855b4c91e, user_id=d9a5178a6ef54207a5f0cc55cf8a4f17, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.842402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.856195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1006/2078] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:12 2022] PUT /identity/v3/projects/2768d8a47a574ae8b578ba6855b4c91e/users/d9a5178a6ef54207a5f0cc55cf8a4f17/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:12.856945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.869174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] MFA Rules not processed for user `5bc7904541d346f79e35c648ec920c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:12.870995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.931332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4cd95-8fb5-43cb-a3a5-699e103d70ac admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:12.936938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff4f45-37e0-404e-8a22-9744281d2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:12.937610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff4f45-37e0-404e-8a22-9744281d2f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:12.937883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff4f45-37e0-404e-8a22-9744281d2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:12.938192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff4f45-37e0-404e-8a22-9744281d2f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:12.939136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff4f45-37e0-404e-8a22-9744281d2f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:12.941084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff4f45-37e0-404e-8a22-9744281d2f3c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:12.956577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1073/2079] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:12.956577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:12.956577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:12.965177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:13.020915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d426dab-fa1f-4998-a4c6-fbbea1ab05eb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.025150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.025956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.026287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.026571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.041203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1007/2080] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:12 2022] POST /identity/v3/projects => generated 407 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:13.042655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.042946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.043226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.070705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] MFA Rules not processed for user `d9a5178a6ef54207a5f0cc55cf8a4f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:13.071935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:13.082527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.084518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.093420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1074/2081] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:13.094244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.095560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:13.110176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bec1f-04b9-4603-8f39-f313be11dbc1 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.136429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:13.157070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1008/2082] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:13.158874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.180643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.181653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.182152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.182440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.183138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.185137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.235053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a371e-13d3-4630-8885-3065dd58a7af None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.240114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.240793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.241112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.241392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.242116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.244082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.274677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1075/2083] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:13 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:13.275513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.277471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:13.333151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dced9-c8b6-4cac-96e8-50a83a8a9801 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.337304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.337945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.338263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.338540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.386687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1009/2084] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:13 2022] POST /identity/v3/users => generated 304 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:13.386687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.397147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0516e-4d68-445c-9141-559b8681f1c3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.406425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.408056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.418537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1076/2085] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:13.419469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.466831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.467664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.468028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.468753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.469884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.472566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.489609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6798-7255-45ba-813c-a6e916b124fc service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.494799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.495498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.495810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.496112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.496859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.498500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.508932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1077/2086] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:13.513064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.545411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd716f1-658a-4ccb-9389-2e1d2628f700 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.561719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.562114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1010/2087] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:13 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:13.562628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.563150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.563560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.563993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.564751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.566780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.579362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa2f0-47bd-43b8-8018-465515525ca7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.583883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1078/2088] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:13.587046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.592180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.592923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.593223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.593504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.594333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.596039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.608448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585376-b38d-4875-a425-a910ded0f9c0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.614320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1011/2089] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:13.617184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.628488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee6727-09fe-4323-98a4-525811826a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.629524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee6727-09fe-4323-98a4-525811826a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.629966 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee6727-09fe-4323-98a4-525811826a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.630348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee6727-09fe-4323-98a4-525811826a16 admin admin] PATH_INFO: `/v3/projects/eadf0ae64b0d4cd98d47fec6980b6f95/users/582f7234f3a148d7bf534840818d10a1/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.634733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fa0f1-c018-4445-9a55-a076ff88e336 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.648903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.651318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.651813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.652094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee6727-09fe-4323-98a4-525811826a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadf0ae64b0d4cd98d47fec6980b6f95, user_id=582f7234f3a148d7bf534840818d10a1, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.652209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] PATH_INFO: `/v3/projects/e738529494cc4721a5049a9ea08f30f0/users/e6deee9afb924aac95bf48b6d1317a22/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.655502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee6727-09fe-4323-98a4-525811826a16 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.675132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e738529494cc4721a5049a9ea08f30f0, user_id=e6deee9afb924aac95bf48b6d1317a22, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.677085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.808706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1079/2091] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:13 2022] PUT /identity/v3/projects/eadf0ae64b0d4cd98d47fec6980b6f95/users/582f7234f3a148d7bf534840818d10a1/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:13.809154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1012/2091] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:13 2022] PUT /identity/v3/projects/e738529494cc4721a5049a9ea08f30f0/users/e6deee9afb924aac95bf48b6d1317a22/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:13.822721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.823891 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.824063 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.824590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:13.911339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] MFA Rules not processed for user `582f7234f3a148d7bf534840818d10a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:13.924297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:13.949460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f7fa-7da1-443e-a25c-cbe4b1c6fb54 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:13.958582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:13.959789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:13.960515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:13.961272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:13.961272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:13.961779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:13.963569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:13.979814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1013/2092] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:13.983646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.015973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa62397-0dd4-4a6e-a2de-5fe38a71e271 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.023520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.024786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.025354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.026121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] PATH_INFO: `/v3/projects/e738529494cc4721a5049a9ea08f30f0/users/e6deee9afb924aac95bf48b6d1317a22/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.026587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1080/2093] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:14.027869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.029807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e738529494cc4721a5049a9ea08f30f0, user_id=e6deee9afb924aac95bf48b6d1317a22, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.033264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.051008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1014/2094] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:13 2022] PUT /identity/v3/projects/e738529494cc4721a5049a9ea08f30f0/users/e6deee9afb924aac95bf48b6d1317a22/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:14.054549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.059863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eef21-4117-4f72-8b19-59b5576d27b3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.149451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.150369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.150802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.151735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.152587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.155174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.187345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e341a-db82-4937-a6f4-7a6a83237ffd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.194512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.195711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.196008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.196367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] PATH_INFO: `/v3/users/627e89ae45734ccd866a52dae23b912a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.198236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=627e89ae45734ccd866a52dae23b912a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.202105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.371452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1081/2095] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:14 2022] POST /identity/v3/projects => generated 409 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:14.377896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.472705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d8b4-c9c0-4fc8-afe7-4a0d8f44fb71 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.479103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.479745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.480031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.480309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.481017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.483115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.561562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627e89ae45734ccd866a52dae23b912a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:14.578506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627e89ae45734ccd866a52dae23b912a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:14.602220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1082/2096] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:14 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:14.607374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.612893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568a9c-1f2d-411c-8c13-6635fb0e4783 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.618014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.618782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.619070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.619351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.620077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.621683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.632760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1083/2097] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:14.636762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.646175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35440-d739-409e-a468-22f0e3a90322 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.650878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.651724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.652001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.652277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] PATH_INFO: `/v3/projects/911ef34802be400382526410f79a4275/users/d9caa6233950401a8927367604f2d1eb/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.666996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911ef34802be400382526410f79a4275, user_id=d9caa6233950401a8927367604f2d1eb, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.669656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.701582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627e89ae45734ccd866a52dae23b912a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:14.710634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627e89ae45734ccd866a52dae23b912a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:14.711821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6c9391e8-587e-470e-91e3-3d69b2ebf5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627e89ae45734ccd866a52dae23b912a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:14.720738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1015/2098] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:14 2022] DELETE /identity/v3/users/627e89ae45734ccd866a52dae23b912a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:14.722190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.722423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.722705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.742101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:14.743615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:14.811472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1016/2099] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:14.818075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.820316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:14.873064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1084/2100] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:14 2022] PUT /identity/v3/projects/911ef34802be400382526410f79a4275/users/d9caa6233950401a8927367604f2d1eb/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:14.876704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.878323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:14.878579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209896-844c-42da-8539-24b2d48ab5b7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.932155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.932875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.933164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.933445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.944236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.945780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.946183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8f103-f4ba-4451-9d32-b4c0b8a7a6b8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.950825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872429b-fd59-40af-bef6-0a791b97c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.951483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872429b-fd59-40af-bef6-0a791b97c4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.951770 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872429b-fd59-40af-bef6-0a791b97c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.952111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872429b-fd59-40af-bef6-0a791b97c4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.952852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872429b-fd59-40af-bef6-0a791b97c4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.954520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872429b-fd59-40af-bef6-0a791b97c4cb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.955778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1017/2101] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:14.965612 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1085/2102] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:14.970106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:14.980628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243fd4d-0ea3-4281-96e2-52a1b461a5ad service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:14.985882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:14.986819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:14.987098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:14.987371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] PATH_INFO: `/v3/projects/911ef34802be400382526410f79a4275/users/d9caa6233950401a8927367604f2d1eb/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:14.989885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=911ef34802be400382526410f79a4275, user_id=d9caa6233950401a8927367604f2d1eb, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:14.993739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:14.999942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:15.011008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1018/2103] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:14 2022] PUT /identity/v3/projects/911ef34802be400382526410f79a4275/users/d9caa6233950401a8927367604f2d1eb/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:15.020873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:15.022204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:15.022700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:15.061633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] MFA Rules not processed for user `d9caa6233950401a8927367604f2d1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:15.063221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:15.156540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1086/2104] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:15.167678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:15.169910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:15.240047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d046a-fc4f-4f13-8e32-5574a5c04dac admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:15.244323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:15.244985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:15.245269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:15.245555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:15.255442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:15.257486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:15.267966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1019/2105] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:15.465791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:15.467268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:15.542194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae37ef-45e6-4dfb-86f8-ddf7faa8e402 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:15.546940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:15.547796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:15.548062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:15.548337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] PATH_INFO: `/v3/projects/a24d934fb0b94eb4af2653452a8aba88` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:15.549508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24d934fb0b94eb4af2653452a8aba88)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:15.551483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:15.681112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24d934fb0b94eb4af2653452a8aba88', 'request_id': 'req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:15.701591 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:15.711016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baefac-eeb8-404e-bfa8-7625744cf992 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:15.757797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24d934fb0b94eb4af2653452a8aba88', 'request_id': 'req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:15.761886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:15.762908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:15.763200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:15.763480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:15.765731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24d934fb0b94eb4af2653452a8aba88', 'request_id': 'req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:15.765958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:15.779501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] The token cache is being invalidate because project a24d934fb0b94eb4af2653452a8aba88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:15.780018 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:15.781002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:15.785551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1087/2106] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:15 2022] DELETE /identity/v3/projects/a24d934fb0b94eb4af2653452a8aba88 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:15.786531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:15.788051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:15.842375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:15.847796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0df2f-0ed3-4945-9f50-dfcca7f4f3ab service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:15.864009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1020/2107] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:15.866448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83d60-e5bf-4d96-ad4b-47d39bb5ebc7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:15.867141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83d60-e5bf-4d96-ad4b-47d39bb5ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:15.872352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83d60-e5bf-4d96-ad4b-47d39bb5ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:15.882682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c77ac8-a1ac-4b76-a1b4-02f0d289ac89 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:15.888823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:15.889785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:15.891808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:15.892265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] PATH_INFO: `/v3/users/d9a5178a6ef54207a5f0cc55cf8a4f17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:15.898755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a5178a6ef54207a5f0cc55cf8a4f17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:15.901036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:15.906154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:15.914068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a3d83d60-e5bf-4d96-ad4b-47d39bb5ebc7 None None] MFA Rules not processed for user `e6deee9afb924aac95bf48b6d1317a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:15.916016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a3d83d60-e5bf-4d96-ad4b-47d39bb5ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:15.992241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1021/2108] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:16.003040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:16.003040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:16.003412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:16.021932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] MFA Rules not processed for user `5bc7904541d346f79e35c648ec920c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:16.023106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:16.078592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1022/2109] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:16.091102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:16.092537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:16.166218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a5178a6ef54207a5f0cc55cf8a4f17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:16.166970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a5178a6ef54207a5f0cc55cf8a4f17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:16.179278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a5178a6ef54207a5f0cc55cf8a4f17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:16.179985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3011788-63b5-4dde-a084-bf5515b77aee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:16.187422 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:16.188100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:16.188391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:16.188707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:16.189141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a5178a6ef54207a5f0cc55cf8a4f17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:16.190834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:16.205175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:16.207078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:16.223890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1023/2110] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:16.278521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5379ba31-d6ee-4262-beca-e75e797cf320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a5178a6ef54207a5f0cc55cf8a4f17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:16.285083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1088/2111] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:15 2022] DELETE /identity/v3/users/d9a5178a6ef54207a5f0cc55cf8a4f17 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:16.640500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:16.957144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:16.957144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:16.970723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff567bd5-8c1c-4763-9e55-11674a2336f3 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:17.041840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:17.042765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:17.043084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:17.043349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] PATH_INFO: `/v3/projects/2768d8a47a574ae8b578ba6855b4c91e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:17.044540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2768d8a47a574ae8b578ba6855b4c91e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:17.046498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:17.281099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2768d8a47a574ae8b578ba6855b4c91e', 'request_id': 'req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:17.287242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2768d8a47a574ae8b578ba6855b4c91e', 'request_id': 'req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:17.292809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2768d8a47a574ae8b578ba6855b4c91e', 'request_id': 'req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:17.449978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] The token cache is being invalidate because project 2768d8a47a574ae8b578ba6855b4c91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:17.450306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:17.450939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-69aaa261-d0f2-4941-82b5-c1e1e9545ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:17.452540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1024/2112] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:16 2022] DELETE /identity/v3/projects/2768d8a47a574ae8b578ba6855b4c91e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:17.457553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:17.458061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:17.458163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:17.477420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:17.478649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:17.538081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1089/2113] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:17.551679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:17.551971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:17.552258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:17.571543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:17.572765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:17.581194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1025/2114] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:17.586081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:17.596002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eb04d-1941-4219-b01d-bb02eb1ceca4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:17.602258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:17.602258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:17.602258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:17.602565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:17.603250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:17.603562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:17.605172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:17.616867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1090/2115] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:17.621302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:17.631435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ef61a-102a-4ef4-bed7-a5cfc71851f3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:17.636717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:17.643604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:17.643604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:17.643604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:17.643604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:17.643604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:17.800480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1026/2116] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:17 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:17.802982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:17.813205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf418e7-a934-4372-87cf-e79fb28738c1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:17.878282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:17.879353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:17.879353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:17.879551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:17.880266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:17.882830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:17.982815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1091/2117] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:17 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:17.986739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:17.997361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885598cd-68ef-4399-905a-1ec27c541d02 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:18.002412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:18.003094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:18.003383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:18.003662 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:18.004431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:18.006631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:18.018480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1027/2118] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:18.023228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:18.033547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a27be-54bb-478b-960b-285a87bab6b3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:18.038593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5457827-f5f3-417e-a562-a1ab0373e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:18.039262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457827-f5f3-417e-a562-a1ab0373e6be admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:18.039546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457827-f5f3-417e-a562-a1ab0373e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:18.039878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457827-f5f3-417e-a562-a1ab0373e6be admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:18.040618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5457827-f5f3-417e-a562-a1ab0373e6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:18.042341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5457827-f5f3-417e-a562-a1ab0373e6be admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:18.053112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1092/2119] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:18.057475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:18.067739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858090cb-6c7f-415a-83a9-d9595ebc6b05 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:18.073260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:18.074215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:18.074500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:18.074781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] PATH_INFO: `/v3/projects/d1c93ae0138444dcbdf489095e5401c2/users/90e8d8333bc74660a5518f3445f5fb47/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:18.089830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c93ae0138444dcbdf489095e5401c2, user_id=90e8d8333bc74660a5518f3445f5fb47, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:18.092534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:18.167765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1028/2120] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:18 2022] PUT /identity/v3/projects/d1c93ae0138444dcbdf489095e5401c2/users/90e8d8333bc74660a5518f3445f5fb47/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:18.178483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:18.178778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:18.179061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:18.211457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] MFA Rules not processed for user `90e8d8333bc74660a5518f3445f5fb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:18.212761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:18.279211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1093/2121] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:18.292659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:18.294477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:18.352070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc5b95-807a-40a8-a5f9-56b8be636c78 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:18.355787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd7d9a-0d16-4842-872d-e9d2ddb620ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:18.356434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7d9a-0d16-4842-872d-e9d2ddb620ce service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:18.356717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7d9a-0d16-4842-872d-e9d2ddb620ce service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:18.356990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7d9a-0d16-4842-872d-e9d2ddb620ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:18.365874 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd7d9a-0d16-4842-872d-e9d2ddb620ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:18.367341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd7d9a-0d16-4842-872d-e9d2ddb620ce service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:18.376271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1029/2122] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:18.790061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:18.844571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:20.625974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:21.329367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:22.947132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:22.952012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:23.045981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a6139-0078-42a8-9a02-dbb231ea7553 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:23.051587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:23.056342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:23.058573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:23.058881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:23.059145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] PATH_INFO: `/v3/users/08f2ee76f3874a78a58b3ccd38eb0e17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:23.060515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f2ee76f3874a78a58b3ccd38eb0e17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:23.062600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:23.276673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f2ee76f3874a78a58b3ccd38eb0e17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.277365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f2ee76f3874a78a58b3ccd38eb0e17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.291794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f2ee76f3874a78a58b3ccd38eb0e17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.301241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f2ee76f3874a78a58b3ccd38eb0e17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.356673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f2ee76f3874a78a58b3ccd38eb0e17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.364371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1094/2123] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:22 2022] DELETE /identity/v3/users/08f2ee76f3874a78a58b3ccd38eb0e17 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:23.369675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:23.369965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:23.370290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:23.390284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:23.390809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:23.392199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:23.392671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:23.463288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1030/2124] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:23.472976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:23.475805 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:23.479817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147531-0486-4cad-806e-965b18879c7a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:23.484595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:23.485483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:23.485770 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:23.486082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] PATH_INFO: `/v3/users/0832de36f3d04557bb401ed9f9b14ba4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:23.487302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0832de36f3d04557bb401ed9f9b14ba4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:23.492674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:23.545180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf561c6-2591-48c6-9d27-8ba607c73d30 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:23.548953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:23.549612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:23.549899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:23.550212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:23.560685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:23.562180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:23.572225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1031/2125] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:23.727228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:23.742634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0832de36f3d04557bb401ed9f9b14ba4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.743315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0832de36f3d04557bb401ed9f9b14ba4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.755333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0832de36f3d04557bb401ed9f9b14ba4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.762271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0832de36f3d04557bb401ed9f9b14ba4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.883231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0832de36f3d04557bb401ed9f9b14ba4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:23.889924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1095/2126] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:23 2022] DELETE /identity/v3/users/0832de36f3d04557bb401ed9f9b14ba4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:24.049928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.052298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.071129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb6fc2-d96f-4da1-b728-34f21e4b056c service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.145227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.146147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.146976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.147258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] PATH_INFO: `/v3/projects/e6c844a2727b41d38137c0108b54eb53` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.148446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c844a2727b41d38137c0108b54eb53)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.150403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.265333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.265862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.280220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177851-a7ea-4117-9138-9c5f315d21f2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.285712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.286636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.287549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.287833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] PATH_INFO: `/v3/projects/1ac32bd147344e28accbed1c643b318f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.289040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac32bd147344e28accbed1c643b318f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.291370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.354099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c844a2727b41d38137c0108b54eb53', 'request_id': 'req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.361132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c844a2727b41d38137c0108b54eb53', 'request_id': 'req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.367337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c844a2727b41d38137c0108b54eb53', 'request_id': 'req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.461969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac32bd147344e28accbed1c643b318f', 'request_id': 'req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.478322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] The token cache is being invalidate because project e6c844a2727b41d38137c0108b54eb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:24.478610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.479230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1df92ca3-7ccb-48b6-a6dd-a32260ae213a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.480774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1032/2127] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:24 2022] DELETE /identity/v3/projects/e6c844a2727b41d38137c0108b54eb53 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:24.485467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483981-f000-45d6-aa61-a357a858e0db None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.485753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483981-f000-45d6-aa61-a357a858e0db None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.486059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483981-f000-45d6-aa61-a357a858e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.505360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4b483981-f000-45d6-aa61-a357a858e0db None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:24.505920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4b483981-f000-45d6-aa61-a357a858e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.565237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1033/2128] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:24.574261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.574552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.574834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.581204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac32bd147344e28accbed1c643b318f', 'request_id': 'req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.588336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac32bd147344e28accbed1c643b318f', 'request_id': 'req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.593932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:24.595231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.599694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] The token cache is being invalidate because project 1ac32bd147344e28accbed1c643b318f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:24.599993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.600639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5d2a44a-bbea-4199-a904-e84fb7bb8bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:24.602272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1096/2129] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:24 2022] DELETE /identity/v3/projects/1ac32bd147344e28accbed1c643b318f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:24.604315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1034/2130] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:24.608804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.610252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2ed7-2c03-43a8-af8f-674be93af584 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.610670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2ed7-2c03-43a8-af8f-674be93af584 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.611017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2ed7-2c03-43a8-af8f-674be93af584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.618769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68184-3d95-4b65-95d2-515ea88cc5ba None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.623680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.624372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.624654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.627950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.627950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:24.627950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.627950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.631474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-787a2ed7-2c03-43a8-af8f-674be93af584 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:24.632741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-787a2ed7-2c03-43a8-af8f-674be93af584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.644156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1035/2131] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:29:24.644377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1097/2132] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:24.645342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.647076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.649509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.649803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.650125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.664065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f727-0449-4b12-b485-7b536f8d31ed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.669138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.669801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.670111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.670393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.671132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.673069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.676530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:24.678895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:24.687563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1098/2133] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:24.691803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.701356 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae4130-ba6e-40a8-8031-da2890b36046 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.706092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.706757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.707047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.707332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.708072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:24.708386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.710217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.721532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1099/2134] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:29:24.726362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.735846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51813a26-9fa8-43a0-88fb-f0018151f9af admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.741189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.741845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.742167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.742457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.743141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.745059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.791878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1036/2135] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:24.792995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.857264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828888f3-c169-48be-9c62-092011af57b6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.862155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.862778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.863062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.863334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.864013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.866679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.878853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:24.885429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1100/2136] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:24.889471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.951210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c0f5-2071-48c3-93f5-bdd2f0c21802 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.956093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.956838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.957202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.957485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.959019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.961250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:24.970603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1037/2137] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:24.975327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:24.985322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a867d46-bc75-4786-bd6a-a73798999995 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:24.990176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:24.990912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:24.991195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:24.991466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:24.992190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:24.993784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.003508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1038/2138] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:25.008060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.018029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2aac-419f-4fb7-a24c-1e640e3dc5ea admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.023452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.024099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.024383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.024660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.025377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.027034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.037830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1039/2139] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:25.042198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.051977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ecfa-8793-44f0-bf3d-922c2e599526 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.056959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad561079-79f2-4336-b5c6-0e5226310a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.058149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad561079-79f2-4336-b5c6-0e5226310a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.058432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad561079-79f2-4336-b5c6-0e5226310a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.058707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad561079-79f2-4336-b5c6-0e5226310a6a admin admin] PATH_INFO: `/v3/projects/8402043119104727bc1538fa8681085d/users/0cad79a5b00841a89d028d5422769305/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.064167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1101/2140] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:24 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:25.067567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.076031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad561079-79f2-4336-b5c6-0e5226310a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8402043119104727bc1538fa8681085d, user_id=0cad79a5b00841a89d028d5422769305, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.078461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec50f38-f1e1-4f13-970a-f2a2b55689ec admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.079189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad561079-79f2-4336-b5c6-0e5226310a6a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.084686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.085390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.085818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.086185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.086921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.088526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.099288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1102/2141] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:25.103699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.114605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df9a1-eb8a-487b-a034-0c544e3b19bf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.120605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.121297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.121638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.121968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.122985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.124816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.138429 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1103/2142] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:25.142570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.153161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b8df3-558d-45e5-bf9b-5e43879ddaa6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.159547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0608-3acd-4064-98ea-bc7d5d8cd8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.160443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0608-3acd-4064-98ea-bc7d5d8cd8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.160723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0608-3acd-4064-98ea-bc7d5d8cd8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.161000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0608-3acd-4064-98ea-bc7d5d8cd8e6 admin admin] PATH_INFO: `/v3/projects/35d87647754644ccbaa0c2f425b8652c/users/23b06a7649c6454393290c5d8c7e4688/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.177387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a0608-3acd-4064-98ea-bc7d5d8cd8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d87647754644ccbaa0c2f425b8652c, user_id=23b06a7649c6454393290c5d8c7e4688, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.180097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a0608-3acd-4064-98ea-bc7d5d8cd8e6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.193267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1040/2143] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:25 2022] PUT /identity/v3/projects/8402043119104727bc1538fa8681085d/users/0cad79a5b00841a89d028d5422769305/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:25.204246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.204532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.204808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.232848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] MFA Rules not processed for user `0cad79a5b00841a89d028d5422769305`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:25.234580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:25.291389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1104/2144] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:25 2022] PUT /identity/v3/projects/35d87647754644ccbaa0c2f425b8652c/users/23b06a7649c6454393290c5d8c7e4688/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:25.293176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.293708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.294076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.314949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1041/2145] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:25.316448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.321833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:25.323088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:25.389627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897faca-fae7-4746-9389-112ff41ea7ee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.394875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.395545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.398114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.398114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.398114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.401847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.404913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1105/2146] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:25.414464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.415872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:25.475330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eed214-f7cc-48ba-a79d-64dff5e6bcc8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.479091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.479745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.480031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.480306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.489702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.491197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.500976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1106/2147] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:25.531850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1042/2148] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:25 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:25.535682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.546958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360078-4dae-4d82-817d-3bae7a302ee3 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.606554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.607240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.607523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.607801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.608513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.610724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.719107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1107/2149] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:25 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:25.723604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.734393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e0b6-797c-4360-be9b-08c7045b4172 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.739083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.739745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.740536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.740851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.741779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.743952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.754737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1043/2150] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:25.759884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.770157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a82cc-9f99-4b6d-8adb-e5fc82e569ea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.775164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.775840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.777189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.777189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.777428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.778940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.789137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1108/2151] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:25.793405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.804331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a11fd-7775-4ddb-a871-3b2eace729f0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.810375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4efbf9-0861-45bf-bf02-d6cfdcabe720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.811281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4efbf9-0861-45bf-bf02-d6cfdcabe720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.811561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4efbf9-0861-45bf-bf02-d6cfdcabe720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.811844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4efbf9-0861-45bf-bf02-d6cfdcabe720 admin admin] PATH_INFO: `/v3/projects/8817362753b940fe9d9ef14941679d1f/users/c4fdd536d4f2436ba77fafca5d707d19/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.832037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4efbf9-0861-45bf-bf02-d6cfdcabe720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8817362753b940fe9d9ef14941679d1f, user_id=c4fdd536d4f2436ba77fafca5d707d19, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.837519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4efbf9-0861-45bf-bf02-d6cfdcabe720 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.876040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:25.876040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:25.889085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085fc2-3f63-484f-abd8-2a847b6295fc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:25.894643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:25.895523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.895808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.896132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] PATH_INFO: `/v3/users/582f7234f3a148d7bf534840818d10a1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.897332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582f7234f3a148d7bf534840818d10a1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:25.899529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:25.958764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1044/2152] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:25 2022] PUT /identity/v3/projects/8817362753b940fe9d9ef14941679d1f/users/c4fdd536d4f2436ba77fafca5d707d19/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:25.968778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:25.969064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:25.969343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:25.996922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] MFA Rules not processed for user `c4fdd536d4f2436ba77fafca5d707d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:25.998167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:26.044890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:26.073755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1045/2153] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:26.078231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.136212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582f7234f3a148d7bf534840818d10a1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:26.136895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582f7234f3a148d7bf534840818d10a1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:26.150729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582f7234f3a148d7bf534840818d10a1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:26.161748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582f7234f3a148d7bf534840818d10a1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:26.163413 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae292-a59b-4523-83b9-fc2381b076f3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.170326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.171278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.171789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.172352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.173253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.175487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.249855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-64ca90e4-740c-4a21-9835-47a683e5d658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582f7234f3a148d7bf534840818d10a1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:26.260250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1109/2154] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:25 2022] DELETE /identity/v3/users/582f7234f3a148d7bf534840818d10a1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:26.262303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.262600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.262972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.263321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1046/2155] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:26 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:26.264248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.265946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:26.281605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:26.282859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:26.342616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2f4b-d5a7-401d-8aae-d09546754299 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.348059 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.348732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.349022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.349331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.350058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.352051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.358352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1110/2156] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:26.366937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.368646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:26.431392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68d8fd-3ab1-4965-85dd-ee5eb4a01cf6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.436307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.437200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.437553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.443568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.452403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.453894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.466273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1111/2157] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:26.470370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1047/2158] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:26 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:26.471830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.483875 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d55d7-41e4-4cb7-85b8-f004a93a04f7 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.488723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.494491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.494491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.494491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.494491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.494491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.507199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1112/2159] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:26.508596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.518862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a36ea0-c542-4d97-97ec-242ee8f76b74 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.524001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.524897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.525187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.525476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] PATH_INFO: `/v3/projects/6467bf4aa96345f5b36c3e9bd38f9096/users/7b4fcef20bca484b9981fadf07ecce8e/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.541535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6467bf4aa96345f5b36c3e9bd38f9096, user_id=7b4fcef20bca484b9981fadf07ecce8e, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.544241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.599104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:26.633464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1048/2160] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:26 2022] PUT /identity/v3/projects/6467bf4aa96345f5b36c3e9bd38f9096/users/7b4fcef20bca484b9981fadf07ecce8e/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:26.637556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.651237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd230108-1f86-44a8-bb2a-5843b3791099 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.718247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c025c92-bd15-471e-8b7c-4d8bc543f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.718931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c025c92-bd15-471e-8b7c-4d8bc543f143 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.719221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c025c92-bd15-471e-8b7c-4d8bc543f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.719503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c025c92-bd15-471e-8b7c-4d8bc543f143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.720639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c025c92-bd15-471e-8b7c-4d8bc543f143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.722846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c025c92-bd15-471e-8b7c-4d8bc543f143 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.734253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1113/2161] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:26.738183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.749303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9406e8d-1271-480f-92e2-aa91d94e4283 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.754307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.755187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.756077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.756399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] PATH_INFO: `/v3/projects/6467bf4aa96345f5b36c3e9bd38f9096/users/7b4fcef20bca484b9981fadf07ecce8e/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.758465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6467bf4aa96345f5b36c3e9bd38f9096, user_id=7b4fcef20bca484b9981fadf07ecce8e, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:26.761130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:26.771844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1049/2162] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:26 2022] PUT /identity/v3/projects/6467bf4aa96345f5b36c3e9bd38f9096/users/7b4fcef20bca484b9981fadf07ecce8e/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:26.790448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730041c-f259-4598-b468-19259ca35eff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.790748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730041c-f259-4598-b468-19259ca35eff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.791153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730041c-f259-4598-b468-19259ca35eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.818369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2730041c-f259-4598-b468-19259ca35eff None None] MFA Rules not processed for user `7b4fcef20bca484b9981fadf07ecce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:26.819586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2730041c-f259-4598-b468-19259ca35eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:26.897129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1114/2163] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:26.911238 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:26.913814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:26.988555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bbc5-fce4-4fc8-9c9d-5fdc863b2422 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:26.993414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:26.994141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:26.994427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:26.994707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:26.996763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:27.076819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:27.078383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:27.092416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1050/2164] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:27.132989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730041c-f259-4598-b468-19259ca35eff None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:27.134808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2730041c-f259-4598-b468-19259ca35eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:27.234375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730041c-f259-4598-b468-19259ca35eff None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:27.239308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:27.240835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:27.241208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:27.241499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] PATH_INFO: `/v3/projects/eadf0ae64b0d4cd98d47fec6980b6f95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:27.242883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadf0ae64b0d4cd98d47fec6980b6f95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:27.245030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:27.384198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadf0ae64b0d4cd98d47fec6980b6f95', 'request_id': 'req-88b71141-ece4-4eb1-86f1-4665b5527dcf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.479743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadf0ae64b0d4cd98d47fec6980b6f95', 'request_id': 'req-88b71141-ece4-4eb1-86f1-4665b5527dcf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.490407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadf0ae64b0d4cd98d47fec6980b6f95', 'request_id': 'req-88b71141-ece4-4eb1-86f1-4665b5527dcf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.499258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] The token cache is being invalidate because project eadf0ae64b0d4cd98d47fec6980b6f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:27.499547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.500214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.502322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1115/2165] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:27 2022] DELETE /identity/v3/projects/eadf0ae64b0d4cd98d47fec6980b6f95 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:27.506737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:27.513202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:27.518192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55594b-a665-4b54-a99a-4347410f966f service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:27.591649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:27.592956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:27.593502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:27.593986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] PATH_INFO: `/v3/users/d9caa6233950401a8927367604f2d1eb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:27.595963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9caa6233950401a8927367604f2d1eb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:27.598477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:27.903930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9caa6233950401a8927367604f2d1eb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.921664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9caa6233950401a8927367604f2d1eb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:27.999010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9caa6233950401a8927367604f2d1eb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:28.013454 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9caa6233950401a8927367604f2d1eb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:28.013810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b8d654e2-cb41-453f-9a91-2f3af8a451e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9caa6233950401a8927367604f2d1eb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:28.038418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1051/2166] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:27 2022] DELETE /identity/v3/users/d9caa6233950401a8927367604f2d1eb => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:28.365436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:28.607012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:28.608526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:28.622171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71141-ece4-4eb1-86f1-4665b5527dcf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:28.690514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:28.691728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:28.692091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:28.692441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] PATH_INFO: `/v3/projects/911ef34802be400382526410f79a4275` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:28.694766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] RBAC: Authorizing `identity:delete_project(project_id=911ef34802be400382526410f79a4275)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:28.696816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:28.899613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911ef34802be400382526410f79a4275', 'request_id': 'req-b51645ad-3a53-47ef-b7fe-7898ce33fead'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:29.040742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911ef34802be400382526410f79a4275', 'request_id': 'req-b51645ad-3a53-47ef-b7fe-7898ce33fead'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:29.048170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911ef34802be400382526410f79a4275', 'request_id': 'req-b51645ad-3a53-47ef-b7fe-7898ce33fead'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:29.062880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] The token cache is being invalidate because project 911ef34802be400382526410f79a4275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:29.063043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:29.063602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b51645ad-3a53-47ef-b7fe-7898ce33fead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:29.080791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1116/2167] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:28 2022] DELETE /identity/v3/projects/911ef34802be400382526410f79a4275 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:29.086242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.086537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.086823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.113090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:29.117029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:29.213263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1052/2168] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:29.221755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.222091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.222365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.253475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:29.269635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:29.283087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:29.299643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1117/2169] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:29.304582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.317118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48124-5c51-45a7-840a-c5603693b699 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.322661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.324706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.325005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.325289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.326773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:29.327099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.337513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.338400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:29.341090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:29.358409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1053/2170] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:29.366644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.377900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068df02-ded2-47c8-bf9a-84a61e3f6de3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.384247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.385730 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.386191 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.386762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.387911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.390204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:29.433933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302417f0-914a-43c2-bcc3-7c1903f646d1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.441793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.442602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.442954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.443240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.445279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:29.522997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.527044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:29.538047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1054/2171] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:29 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:29.541573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.546212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1118/2172] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:29.625843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde07a-cf0f-4ad8-9681-4609fd820129 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.633048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.633825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.634316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.634667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.635626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.638493 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:29.796297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1055/2173] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:29 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:29.800061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.811464 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701833f-c9f1-47be-90d3-e4a082121b68 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.819710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.822117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.826741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.826741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.826741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.830615 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:29.844062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1119/2174] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:29.847913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.859713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824143-99d1-4ff5-9539-1bc45872283a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.864487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fdde-0cfb-463a-b687-961881dc405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.865223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fdde-0cfb-463a-b687-961881dc405c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.865686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fdde-0cfb-463a-b687-961881dc405c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.865816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fdde-0cfb-463a-b687-961881dc405c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.866597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3fdde-0cfb-463a-b687-961881dc405c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.871863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3fdde-0cfb-463a-b687-961881dc405c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:29.882924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1056/2175] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:29.883965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:29.901972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c2ce-875c-43c8-9fa7-bddf93971f71 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:29.907197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:29.908175 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:29.908627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:29.908979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] PATH_INFO: `/v3/projects/6b730eeb6a724b47af4683f12c8163f8/users/15ce060ae4d0414698e3f2934538ff4b/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:29.931461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b730eeb6a724b47af4683f12c8163f8, user_id=15ce060ae4d0414698e3f2934538ff4b, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:29.937627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:30.058083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1120/2176] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:29 2022] PUT /identity/v3/projects/6b730eeb6a724b47af4683f12c8163f8/users/15ce060ae4d0414698e3f2934538ff4b/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:30.067812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870776-0e39-4956-9676-eb6430472b51 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:30.068661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870776-0e39-4956-9676-eb6430472b51 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:30.068876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870776-0e39-4956-9676-eb6430472b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:30.106097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-73870776-0e39-4956-9676-eb6430472b51 None None] MFA Rules not processed for user `15ce060ae4d0414698e3f2934538ff4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:30.108523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73870776-0e39-4956-9676-eb6430472b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:30.203268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1057/2177] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:30.224900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:30.225975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:30.298372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8283b-1794-4f22-9e1b-15a810ac2372 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:30.302405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69591f6-9dea-445e-86c0-011a3e3d4b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:30.303161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69591f6-9dea-445e-86c0-011a3e3d4b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:30.303558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69591f6-9dea-445e-86c0-011a3e3d4b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:30.303916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69591f6-9dea-445e-86c0-011a3e3d4b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:30.322114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69591f6-9dea-445e-86c0-011a3e3d4b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:30.323697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69591f6-9dea-445e-86c0-011a3e3d4b29 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:30.352285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1121/2178] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:30.364073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870776-0e39-4956-9676-eb6430472b51 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:30.446462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870776-0e39-4956-9676-eb6430472b51 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:30.456461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:30.456846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:30.457228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:30.457780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] PATH_INFO: `/v3/users/15ce060ae4d0414698e3f2934538ff4b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:30.459227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ce060ae4d0414698e3f2934538ff4b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:30.461497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:30.698478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ce060ae4d0414698e3f2934538ff4b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:30.718464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ce060ae4d0414698e3f2934538ff4b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:30.798338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ce060ae4d0414698e3f2934538ff4b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:30.821193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ce060ae4d0414698e3f2934538ff4b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:30.821975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ce060ae4d0414698e3f2934538ff4b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:30.831257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1058/2179] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:30 2022] DELETE /identity/v3/users/15ce060ae4d0414698e3f2934538ff4b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:30.836897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:30.837719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:30.841649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:30.855889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:30.857381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:30.936582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1122/2180] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:30.947355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:30.951126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:31.040298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b20f1-26d5-41b6-86a2-5e076e07bbc2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:31.042850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:31.043735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:31.044188 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:31.044466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:31.055228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:31.056721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:31.068923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1059/2181] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:31.165439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:31.336590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:31.426386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:31.428214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:31.526751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1347-d458-4e92-8916-9de553dd0d37 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:31.530599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:31.531376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:31.531678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:31.531955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:31.534372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:31.631350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:31.632890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c212f6a-ed62-4711-9624-8c453f5f9db1 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:31.661473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1123/2182] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:31.903862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:31.908190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:31.925837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb003df-6983-4a8b-8183-b1c445829ef3 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:31.939549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:31.940589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:31.941017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:31.941297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] PATH_INFO: `/v3/projects/6b730eeb6a724b47af4683f12c8163f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:31.942633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b730eeb6a724b47af4683f12c8163f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:31.945331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.104286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b730eeb6a724b47af4683f12c8163f8', 'request_id': 'req-193f63bb-b1e2-4a35-b985-e58f8dec94a2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:32.112339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b730eeb6a724b47af4683f12c8163f8', 'request_id': 'req-193f63bb-b1e2-4a35-b985-e58f8dec94a2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:32.128938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b730eeb6a724b47af4683f12c8163f8', 'request_id': 'req-193f63bb-b1e2-4a35-b985-e58f8dec94a2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:32.248879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] The token cache is being invalidate because project 6b730eeb6a724b47af4683f12c8163f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:32.248879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:32.249745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-193f63bb-b1e2-4a35-b985-e58f8dec94a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:32.252141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1060/2183] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:31 2022] DELETE /identity/v3/projects/6b730eeb6a724b47af4683f12c8163f8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:32.257616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cd65-6b0a-42e4-8dd2-370e3f69c947 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.258520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cd65-6b0a-42e4-8dd2-370e3f69c947 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.258819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cd65-6b0a-42e4-8dd2-370e3f69c947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.281493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d9c8cd65-6b0a-42e4-8dd2-370e3f69c947 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:32.282760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9c8cd65-6b0a-42e4-8dd2-370e3f69c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:32.390047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1124/2184] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:32.402341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.402993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.403553 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.432751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:32.434416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:32.457473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb54f-8ac2-4eb2-8d67-d4160ec4fdd6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.457771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb54f-8ac2-4eb2-8d67-d4160ec4fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.458189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1061/2185] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:32.458840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb54f-8ac2-4eb2-8d67-d4160ec4fdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.462279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.475008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4451f03-d94b-43f2-874c-c8dcbc3db63d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.480838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.482171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.482872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.483479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.484445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:32.484985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:32.486896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.492741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6a8eb54f-8ac2-4eb2-8d67-d4160ec4fdd6 None None] MFA Rules not processed for user `23b06a7649c6454393290c5d8c7e4688`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:32.494436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6a8eb54f-8ac2-4eb2-8d67-d4160ec4fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:32.505608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1062/2186] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:29:32.506630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.518636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6d02-c3ba-498c-9261-4b99acd3918e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.524272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.525028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.525385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.525735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.526534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:32.528742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.572763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1125/2187] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:32.584598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.584889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.585209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.606130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] MFA Rules not processed for user `23b06a7649c6454393290c5d8c7e4688`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:32.606952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:32.618030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1063/2188] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:32 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:32.618221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1126/2189] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:32.619865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.630293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.631839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:32.721012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec503e-f7eb-485a-9293-ec530e7587ab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.726116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.726806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.727093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.727372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.728131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:32.730151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.731836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde35c3e-b569-4ae3-a928-4c263eb288c8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.809156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.809947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.810270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.810552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.830177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:32.870814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1064/2190] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:32 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:32.871327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:32.872315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.873222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.883339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4989-0054-48a9-bd24-6c30d53b7d21 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.886692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1127/2191] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:32.888716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.889464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.889815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.890201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.891003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:32.892704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.905770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1065/2192] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:32.909605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.920786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653d3cf-fcfa-496d-835a-e0e872b31f68 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.925923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7779-4a02-4c41-877b-5642eea9e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.926712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7779-4a02-4c41-877b-5642eea9e364 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.927089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7779-4a02-4c41-877b-5642eea9e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.927386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7779-4a02-4c41-877b-5642eea9e364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:32.928170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7779-4a02-4c41-877b-5642eea9e364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:32.929756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7779-4a02-4c41-877b-5642eea9e364 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:32.944948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1128/2193] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:32.945497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:32.956060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811324d4-63d7-47af-b36e-2225c205937f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:32.961775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:32.963798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:32.964307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:32.965091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] PATH_INFO: `/v3/projects/9b956f72cee543cf935d8d9e21d9e5d9/users/c9fa69ffa44d4b829062454fa64b33ef/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:33.033682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b956f72cee543cf935d8d9e21d9e5d9, user_id=c9fa69ffa44d4b829062454fa64b33ef, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:33.039049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:33.143369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1066/2194] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:32 2022] PUT /identity/v3/projects/9b956f72cee543cf935d8d9e21d9e5d9/users/c9fa69ffa44d4b829062454fa64b33ef/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:33.156281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a73fa-64ae-4445-a276-1e1883d189e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:33.156593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a73fa-64ae-4445-a276-1e1883d189e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:33.157225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a73fa-64ae-4445-a276-1e1883d189e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:33.184853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a3a73fa-64ae-4445-a276-1e1883d189e9 None None] MFA Rules not processed for user `c9fa69ffa44d4b829062454fa64b33ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:33.186291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a3a73fa-64ae-4445-a276-1e1883d189e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:33.267504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1129/2195] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:33.279722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:33.281859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:33.348592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edfbab-03f3-4c7e-9f20-934d094d51d0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:33.353498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:33.354189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:33.354536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:33.354820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:33.368561 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:33.371708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:33.388117 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1067/2196] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:33.753073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:33.787292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8fcc6-69d8-4770-acc8-b3e70d86ec00 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:33.787292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8fcc6-69d8-4770-acc8-b3e70d86ec00 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:33.787579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8fcc6-69d8-4770-acc8-b3e70d86ec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:33.806566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a2b8fcc6-69d8-4770-acc8-b3e70d86ec00 None None] MFA Rules not processed for user `23b06a7649c6454393290c5d8c7e4688`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:33.809892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a2b8fcc6-69d8-4770-acc8-b3e70d86ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:33.873600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1130/2197] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:34.764902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:37.158134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:37.336256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:37.795713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.797901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:37.868583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063824-bcf7-4d09-bf2d-773fef787599 service glance] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.873264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.874168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.874452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.874727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] PATH_INFO: `/v3/users/0cad79a5b00841a89d028d5422769305` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.876215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cad79a5b00841a89d028d5422769305)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.878251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:38.221037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:38.303003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cad79a5b00841a89d028d5422769305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:38.315143 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cad79a5b00841a89d028d5422769305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:38.404680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cad79a5b00841a89d028d5422769305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:38.425012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cad79a5b00841a89d028d5422769305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:38.428448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cad79a5b00841a89d028d5422769305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:38.439028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1068/2198] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:37 2022] DELETE /identity/v3/users/0cad79a5b00841a89d028d5422769305 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:38.446251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:38.446251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:38.446251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:38.463957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:38.465223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:38.572503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1131/2199] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:38.610395 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:38.615206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:38.716033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43232c3-305e-4598-adf1-ae1c46317942 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:38.719828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:38.720496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:38.720787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:38.721066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:38.731990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:38.733495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:38.745216 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1069/2200] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:39.448924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:39.450623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:39.525762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03ee39-3df0-4cea-9b83-f495d6e50d15 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:39.530052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:39.531000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:39.531500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:39.531975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:39.534367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:39.571684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:39.613663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:39.615775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:39.626300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1132/2201] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:39.644158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:39.680890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:39.682774 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:39.703897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70648e0-be47-4cb7-90d0-518a983563a6 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:39.712135 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:39.713351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:39.714172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:39.714645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] PATH_INFO: `/v3/projects/8402043119104727bc1538fa8681085d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:39.716025 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8402043119104727bc1538fa8681085d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:39.719949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:39.967506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8402043119104727bc1538fa8681085d', 'request_id': 'req-0eb22825-cf5e-4652-9480-1b5bfac2ac99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:39.981948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8402043119104727bc1538fa8681085d', 'request_id': 'req-0eb22825-cf5e-4652-9480-1b5bfac2ac99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:39.992046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8402043119104727bc1538fa8681085d', 'request_id': 'req-0eb22825-cf5e-4652-9480-1b5bfac2ac99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.069127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] The token cache is being invalidate because project 8402043119104727bc1538fa8681085d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:40.069585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.070608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.072765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1070/2202] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:39 2022] DELETE /identity/v3/projects/8402043119104727bc1538fa8681085d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:40.077139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:40.094504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7079d0-aca2-4938-a14a-8c9cd1172994 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:40.192757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:40.193716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:40.194027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:40.194311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] PATH_INFO: `/v3/users/c4fdd536d4f2436ba77fafca5d707d19` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:40.195510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fdd536d4f2436ba77fafca5d707d19)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:40.197438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:40.439810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fdd536d4f2436ba77fafca5d707d19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.440644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fdd536d4f2436ba77fafca5d707d19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.453912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fdd536d4f2436ba77fafca5d707d19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.461337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fdd536d4f2436ba77fafca5d707d19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.529410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fdd536d4f2436ba77fafca5d707d19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:40.537094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1133/2203] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:40 2022] DELETE /identity/v3/users/c4fdd536d4f2436ba77fafca5d707d19 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:40.655582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:41.099494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:41.100956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:41.118623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb22825-cf5e-4652-9480-1b5bfac2ac99 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:41.180683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:41.181592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:41.181867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:41.182175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] PATH_INFO: `/v3/projects/8817362753b940fe9d9ef14941679d1f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:41.183605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8817362753b940fe9d9ef14941679d1f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:41.185518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:41.244292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:41.290332 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8817362753b940fe9d9ef14941679d1f', 'request_id': 'req-b33add8f-8856-4c22-9314-61e1278a618d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.296537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8817362753b940fe9d9ef14941679d1f', 'request_id': 'req-b33add8f-8856-4c22-9314-61e1278a618d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.302042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8817362753b940fe9d9ef14941679d1f', 'request_id': 'req-b33add8f-8856-4c22-9314-61e1278a618d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.391677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] The token cache is being invalidate because project 8817362753b940fe9d9ef14941679d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:41.391971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.392605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.394193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1071/2204] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:41 2022] DELETE /identity/v3/projects/8817362753b940fe9d9ef14941679d1f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:41.398707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:41.400121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:41.413714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17928e29-4a22-4d52-8ddd-321aef0f099c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:41.469183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:41.470080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:41.470370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:41.470653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] PATH_INFO: `/v3/users/7b4fcef20bca484b9981fadf07ecce8e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:41.471838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4fcef20bca484b9981fadf07ecce8e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:41.473781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:41.687052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4fcef20bca484b9981fadf07ecce8e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.687735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4fcef20bca484b9981fadf07ecce8e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.700050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4fcef20bca484b9981fadf07ecce8e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.706874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:41.708799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4fcef20bca484b9981fadf07ecce8e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.832103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3fa5d2e8-a505-4899-983e-f1161ce128a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4fcef20bca484b9981fadf07ecce8e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:41.839112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1134/2205] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:41 2022] DELETE /identity/v3/users/7b4fcef20bca484b9981fadf07ecce8e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:42.288625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:42.290423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:42.311726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33add8f-8856-4c22-9314-61e1278a618d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:42.371680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:42.372567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:42.372873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:42.373155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] PATH_INFO: `/v3/projects/6467bf4aa96345f5b36c3e9bd38f9096` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:42.374386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6467bf4aa96345f5b36c3e9bd38f9096)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:42.376392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:42.484243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6467bf4aa96345f5b36c3e9bd38f9096', 'request_id': 'req-bba689ec-e9d9-4feb-9441-dbb1f911a833'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:42.490495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6467bf4aa96345f5b36c3e9bd38f9096', 'request_id': 'req-bba689ec-e9d9-4feb-9441-dbb1f911a833'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:42.495962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6467bf4aa96345f5b36c3e9bd38f9096', 'request_id': 'req-bba689ec-e9d9-4feb-9441-dbb1f911a833'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:42.620056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] The token cache is being invalidate because project 6467bf4aa96345f5b36c3e9bd38f9096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:42.620375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:42.621030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bba689ec-e9d9-4feb-9441-dbb1f911a833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:42.622632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1072/2206] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:42 2022] DELETE /identity/v3/projects/6467bf4aa96345f5b36c3e9bd38f9096 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:42.627613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:42.628064 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:42.628186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:42.643983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:42.649016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:42.650319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:42.712969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1135/2207] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:42.721100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:42.721436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:42.721724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:42.740289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:42.741502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:42.749654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1073/2208] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:42.753953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:42.764472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f90a4-9fe7-4eb1-8709-4fabd83c283d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:42.769202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:42.769908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:42.770247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:42.770526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:42.771833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:42.773276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:42.773746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:42.785527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1136/2209] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:42.789867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:42.799190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9620-5e6c-49f6-a6c8-00ebae180242 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:42.804341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:42.805044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:42.805330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:42.805612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:42.806367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:42.808609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:42.924999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1074/2210] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:42 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:42.929082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:42.937243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:42.941032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c902d5-3c8c-45af-b87e-75e977d6b288 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:43.000439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:43.001111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.001396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.001678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.002472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:43.004401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:43.117487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1137/2211] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:42 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:43.121452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:43.132453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc675d-48e1-4229-a246-a8cc3fdea62a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:43.137095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:43.137776 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.138102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.138381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.139105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:43.140718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:43.151149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1075/2212] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:43.155057 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:43.165413 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a5e63-5c86-46ad-b2e8-7fdcbc62bb1f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:43.170579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52529-0b5e-4c84-8e04-d072938477e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:43.171270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52529-0b5e-4c84-8e04-d072938477e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.171583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52529-0b5e-4c84-8e04-d072938477e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.171871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52529-0b5e-4c84-8e04-d072938477e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.172607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52529-0b5e-4c84-8e04-d072938477e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:43.174244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52529-0b5e-4c84-8e04-d072938477e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:43.189471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1138/2213] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:43.195507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:43.205715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decb3b7-3424-4f73-8d35-8e8a13e0783a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:43.210428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:43.211298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.211581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.211858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] PATH_INFO: `/v3/projects/5932182ca56b488e90798923858e3de2/users/e2a7cbe63f874036b49f9385152b7268/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.227659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5932182ca56b488e90798923858e3de2, user_id=e2a7cbe63f874036b49f9385152b7268, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:43.230440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:43.266546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:43.352785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1076/2214] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:43 2022] PUT /identity/v3/projects/5932182ca56b488e90798923858e3de2/users/e2a7cbe63f874036b49f9385152b7268/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:29:43.364075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.364542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.365351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.403462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] MFA Rules not processed for user `e2a7cbe63f874036b49f9385152b7268`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:43.403462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:43.459760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1139/2215] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:43.473123 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:43.477114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:43.541933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c09a72-53de-4a04-984f-89258c02252a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:43.545707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac26e3-4e98-43c2-ae72-5dc2454b1c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:43.546389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac26e3-4e98-43c2-ae72-5dc2454b1c71 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.546674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac26e3-4e98-43c2-ae72-5dc2454b1c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.546953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac26e3-4e98-43c2-ae72-5dc2454b1c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.555309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac26e3-4e98-43c2-ae72-5dc2454b1c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:43.556769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac26e3-4e98-43c2-ae72-5dc2454b1c71 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:43.565877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1077/2216] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:44.267603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:44.502399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:45.952802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:46.455328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:47.800564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:47.825434 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:47.994885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca3b9-e923-43f0-a067-6a3089e21b0f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:47.994885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:47.994885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:47.994885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:47.996868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] PATH_INFO: `/v3/users/e2a7cbe63f874036b49f9385152b7268` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:47.996868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a7cbe63f874036b49f9385152b7268)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:47.996868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:48.314775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a7cbe63f874036b49f9385152b7268'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:48.315512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a7cbe63f874036b49f9385152b7268'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:48.328212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a7cbe63f874036b49f9385152b7268'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:48.335077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a7cbe63f874036b49f9385152b7268'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:48.403225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a7cbe63f874036b49f9385152b7268'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:48.409448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1140/2217] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:47 2022] DELETE /identity/v3/users/e2a7cbe63f874036b49f9385152b7268 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:48.414710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:48.415000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:48.415284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:48.433465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:48.434726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:48.493622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1078/2218] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:48.503172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:48.504675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:48.563877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1b43f-dbf1-4152-94f4-89c325a23401 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:48.567940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:48.568230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:48.568518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:48.568800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:48.577815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:48.579290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:48.588930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1141/2219] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:29:48.598222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:49.057038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:49.059781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:49.071386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c74d1-3e49-42de-b1c3-d452c495ae19 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:49.076251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:49.077183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:49.077588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:49.077933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] PATH_INFO: `/v3/projects/5932182ca56b488e90798923858e3de2` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:49.079224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5932182ca56b488e90798923858e3de2)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:49.081391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:49.213562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5932182ca56b488e90798923858e3de2', 'request_id': 'req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.220423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5932182ca56b488e90798923858e3de2', 'request_id': 'req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.226989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5932182ca56b488e90798923858e3de2', 'request_id': 'req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.351300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] The token cache is being invalidate because project 5932182ca56b488e90798923858e3de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:49.351589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.352331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d82694bc-fd4e-4ace-9d33-dbc3625f1a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.353904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1079/2220] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:49 2022] DELETE /identity/v3/projects/5932182ca56b488e90798923858e3de2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:49.358187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:50.523992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:51.147401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:52.569778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:52.889325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:53.186636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:53.243369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:53.490051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:53.541159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:53.958187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.107838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.443617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.506642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.632602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.832161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.963512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:55.238483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:55.323869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:55.603481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:55.717773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:55.969402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:56.015069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:56.277685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:56.403405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:56.472646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:56.997847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:57.026633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:57.660694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:58.095405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:59.226541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:59.632840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:59.944893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:59.946379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:00.021935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f215-adfc-412a-a256-2f864e1822a7 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.077354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.078595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.078882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.079531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] PATH_INFO: `/v3/users/90e8d8333bc74660a5518f3445f5fb47` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.080840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e8d8333bc74660a5518f3445f5fb47)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.082940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.215249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:00.297894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e8d8333bc74660a5518f3445f5fb47'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.298837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e8d8333bc74660a5518f3445f5fb47'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.302344 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:00.313114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e8d8333bc74660a5518f3445f5fb47'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.319815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e8d8333bc74660a5518f3445f5fb47'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.511906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e8d8333bc74660a5518f3445f5fb47'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.518633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1142/2221] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:59 2022] DELETE /identity/v3/users/90e8d8333bc74660a5518f3445f5fb47 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:00.523610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.523898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.524178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.551690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:00.552908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:00.617698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1080/2222] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:00.624419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.626107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:00.722342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77a1aa-b005-4c10-9053-6c6f5a8eb40b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.726139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7102e-b086-4aa1-a0a4-b613edd58863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.726793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7102e-b086-4aa1-a0a4-b613edd58863 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.727202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7102e-b086-4aa1-a0a4-b613edd58863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.727579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7102e-b086-4aa1-a0a4-b613edd58863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.731616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:00.744477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7102e-b086-4aa1-a0a4-b613edd58863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.755906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7102e-b086-4aa1-a0a4-b613edd58863 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.767261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1143/2223] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:00.968823 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.187932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.191890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:01.202477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e698ad6-12ee-4c4c-a674-b8dcc0b5f768 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.207791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.208552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.209206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.209665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] PATH_INFO: `/v3/projects/d1c93ae0138444dcbdf489095e5401c2` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.212071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c93ae0138444dcbdf489095e5401c2)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.214205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.334408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c93ae0138444dcbdf489095e5401c2', 'request_id': 'req-aeb94315-9b50-42e5-ab20-97ebacd249d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:01.340655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c93ae0138444dcbdf489095e5401c2', 'request_id': 'req-aeb94315-9b50-42e5-ab20-97ebacd249d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:01.346353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c93ae0138444dcbdf489095e5401c2', 'request_id': 'req-aeb94315-9b50-42e5-ab20-97ebacd249d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:01.392208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.425649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] The token cache is being invalidate because project d1c93ae0138444dcbdf489095e5401c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:01.425936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:01.427137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-aeb94315-9b50-42e5-ab20-97ebacd249d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:01.428729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1081/2224] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:01 2022] DELETE /identity/v3/projects/d1c93ae0138444dcbdf489095e5401c2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:01.433880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.434355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.434603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.471960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:01.473163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:01.501856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.534708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1144/2225] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:01.543024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.543320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.543602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.563465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:01.572438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:01.574243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1082/2226] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:01.578284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.587832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f529f5-1410-441a-897f-00e46ccc233b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.592817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.593713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.594033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.594322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.595054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:01.595367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.597017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.614225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1145/2227] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:01.615606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.624879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab3178-576d-44f1-8845-a2ceae21ffa1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.630293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.631007 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.631329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.631549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.632264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.634192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.742176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1083/2228] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:01 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:01.746374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.756974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd497-6ebd-4da3-b4b9-705601070385 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.813578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.814283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.814568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.814845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.815536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.818194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.855440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.924670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.930940 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1146/2229] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:01 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:01.936300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.947366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b4c9-84a4-4061-9dee-5071a8d38a70 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.951992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.952639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.952921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.953198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.953922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.955603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.967052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1084/2230] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:01.970988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.981148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4cd61-5d3a-48e0-999e-ef1e244bb4c3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.985846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0587c0-ecfe-48fa-be0d-76f54182573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.986564 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0587c0-ecfe-48fa-be0d-76f54182573b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.986854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0587c0-ecfe-48fa-be0d-76f54182573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.987137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0587c0-ecfe-48fa-be0d-76f54182573b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.987866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0587c0-ecfe-48fa-be0d-76f54182573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.990056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0587c0-ecfe-48fa-be0d-76f54182573b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:02.000560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1147/2231] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:02.005234 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:02.015924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d655c-92d1-42f7-a5c4-aa286026a994 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:02.020932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:02.021809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:02.022129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:02.022411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] PATH_INFO: `/v3/projects/0afacd93a50f460fafbcb75b93a85ba5/users/48f196295bdf4ac99f20494e2b5b4890/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:02.037294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afacd93a50f460fafbcb75b93a85ba5, user_id=48f196295bdf4ac99f20494e2b5b4890, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:02.040012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:02.089277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:02.147824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1085/2232] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:02 2022] PUT /identity/v3/projects/0afacd93a50f460fafbcb75b93a85ba5/users/48f196295bdf4ac99f20494e2b5b4890/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:02.159800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:02.164830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:02.165184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:02.165535 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:02.193595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] MFA Rules not processed for user `48f196295bdf4ac99f20494e2b5b4890`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:02.194970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:02.260554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1148/2233] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:02.271833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:02.273547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:02.278117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:02.330450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8bf0-4c2e-4a3d-a113-fb9f6425d76a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:02.334193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735337e-3b14-4ceb-8bd9-160032fdd600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:02.334832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735337e-3b14-4ceb-8bd9-160032fdd600 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:02.335118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735337e-3b14-4ceb-8bd9-160032fdd600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:02.335394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735337e-3b14-4ceb-8bd9-160032fdd600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:02.344091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735337e-3b14-4ceb-8bd9-160032fdd600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:02.345598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735337e-3b14-4ceb-8bd9-160032fdd600 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:02.362283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1086/2234] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:02.580661 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:02.946663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:03.444158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:04.391915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:04.694744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:05.506419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:05.717733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:05.883657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:05.912021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:06.180754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:06.278658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:09.778945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:09.780584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:09.854933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd023b0-2d16-4d70-a7f0-0110ec6fc0f3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:09.859423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:09.860423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:09.860715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:09.860993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] PATH_INFO: `/v3/users/c9fa69ffa44d4b829062454fa64b33ef` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:09.862233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fa69ffa44d4b829062454fa64b33ef)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:09.864737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:10.038859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fa69ffa44d4b829062454fa64b33ef'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.039519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fa69ffa44d4b829062454fa64b33ef'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.046782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:10.052128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fa69ffa44d4b829062454fa64b33ef'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.059355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fa69ffa44d4b829062454fa64b33ef'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.135773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fa69ffa44d4b829062454fa64b33ef'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.141082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1149/2235] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:09 2022] DELETE /identity/v3/users/c9fa69ffa44d4b829062454fa64b33ef => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:10.146396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.146887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.146999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.165948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:10.167275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:10.220315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:10.234071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1087/2236] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:10.244900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:10.246387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:10.306812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265870c-31a7-4b71-9883-b0b742bb6546 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:10.310763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b2d93-1bf3-4c73-a92b-863a743972cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:10.311414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2d93-1bf3-4c73-a92b-863a743972cd service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.311701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2d93-1bf3-4c73-a92b-863a743972cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.311980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2d93-1bf3-4c73-a92b-863a743972cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.321539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b2d93-1bf3-4c73-a92b-863a743972cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:10.323089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b2d93-1bf3-4c73-a92b-863a743972cd service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:10.332734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1150/2237] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:10.776623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:10.778725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:10.799448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277c2a7-204d-4fac-9035-fa715d75b197 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:10.805359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:10.806488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.806830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.807235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] PATH_INFO: `/v3/projects/9b956f72cee543cf935d8d9e21d9e5d9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.809194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b956f72cee543cf935d8d9e21d9e5d9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:10.811197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:10.926974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b956f72cee543cf935d8d9e21d9e5d9', 'request_id': 'req-954ccc46-1236-42d8-9673-0d5ac6c379b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.937263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b956f72cee543cf935d8d9e21d9e5d9', 'request_id': 'req-954ccc46-1236-42d8-9673-0d5ac6c379b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.946466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b956f72cee543cf935d8d9e21d9e5d9', 'request_id': 'req-954ccc46-1236-42d8-9673-0d5ac6c379b7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:11.076463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] The token cache is being invalidate because project 9b956f72cee543cf935d8d9e21d9e5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:11.076753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:11.077401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-954ccc46-1236-42d8-9673-0d5ac6c379b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:11.079146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1088/2238] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:10 2022] DELETE /identity/v3/projects/9b956f72cee543cf935d8d9e21d9e5d9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:11.092681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.093139 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.093269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.124570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:11.125768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:11.187348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1151/2239] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:11.195386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.195836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.198150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.214530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:11.215978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:11.224487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1089/2240] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:11.228964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.238580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838ad91-d2e4-4c02-9f68-020b1307e4b6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.243953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.244609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.244896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.245177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.245907 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:11.246251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.248037 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.259893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1152/2241] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:11.264190 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.273634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad749e98-a8a2-4d28-bd9c-7d65fa6904eb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.278442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.279085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.279368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.279645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.280340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.282414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.409858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1090/2242] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:11.414488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.425322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2c0b-52f3-4cfd-8a8a-90d8c3b3c360 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.475439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:11.482086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.482739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.483028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.483311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.484032 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.485968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.608750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1153/2243] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:11.613451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.624071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc10db-a204-441f-b51e-79d5ac07248f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.628729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.629379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.629663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.629943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.630719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.632340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.642896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1091/2244] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:11.647229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.657357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1053201-2df2-46f2-9873-f8d494e2405d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.662651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60d899-3dca-4c63-b036-aa7c2f5ca190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.663337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60d899-3dca-4c63-b036-aa7c2f5ca190 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.663625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60d899-3dca-4c63-b036-aa7c2f5ca190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.663923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60d899-3dca-4c63-b036-aa7c2f5ca190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.664647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60d899-3dca-4c63-b036-aa7c2f5ca190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.666899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60d899-3dca-4c63-b036-aa7c2f5ca190 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.678013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1154/2245] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:11.682254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.692707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2680-013a-43c8-a554-76b860a78ca9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.697494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.698472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.698762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.699035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] PATH_INFO: `/v3/projects/23dc4a0377a344f5ba786bef3e9c1626/users/8cf212e796d7426d93d799ef723b7a69/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.714291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dc4a0377a344f5ba786bef3e9c1626, user_id=8cf212e796d7426d93d799ef723b7a69, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.717128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.834999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1092/2246] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:11 2022] PUT /identity/v3/projects/23dc4a0377a344f5ba786bef3e9c1626/users/8cf212e796d7426d93d799ef723b7a69/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:11.847621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.847915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.848200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.877860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] MFA Rules not processed for user `8cf212e796d7426d93d799ef723b7a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:11.879235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:11.946386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1155/2247] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:12.417888 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.419801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:12.477049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6e6d2-4452-41e5-b293-87931ff42f56 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.480716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.481435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.481720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.482028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.491289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.493138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.502380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1093/2248] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:19.662192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:19.664455 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:19.731699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc1607-ce3f-4703-b41f-dd8ac5937662 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:19.736252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:19.737120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:19.737406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:19.737688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] PATH_INFO: `/v3/users/5bc7904541d346f79e35c648ec920c43` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:19.739421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc7904541d346f79e35c648ec920c43)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:19.741382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:20.011343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc7904541d346f79e35c648ec920c43'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:20.011997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc7904541d346f79e35c648ec920c43'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:20.024361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc7904541d346f79e35c648ec920c43'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:20.025886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:20.032638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc7904541d346f79e35c648ec920c43'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:20.151379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc7904541d346f79e35c648ec920c43'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:20.177212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1156/2249] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:19 2022] DELETE /identity/v3/users/5bc7904541d346f79e35c648ec920c43 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:20.510420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:20.534439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ab3a-def9-43ab-b0ca-6a0cd0c519e0 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:20.545891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:20.604220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:20.605161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:20.605614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:20.607859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] PATH_INFO: `/v3/projects/272b8346885e4beba4f663fa6a5e1cb6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:20.609697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272b8346885e4beba4f663fa6a5e1cb6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:20.611826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:21.149491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272b8346885e4beba4f663fa6a5e1cb6', 'request_id': 'req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.158437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272b8346885e4beba4f663fa6a5e1cb6', 'request_id': 'req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.171202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272b8346885e4beba4f663fa6a5e1cb6', 'request_id': 'req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.351757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] The token cache is being invalidate because project 272b8346885e4beba4f663fa6a5e1cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:21.361239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.361239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.361239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1094/2250] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:20 2022] DELETE /identity/v3/projects/272b8346885e4beba4f663fa6a5e1cb6 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:21.361620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:21.361620 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:21.373203 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07120e6-a3df-4a27-a296-f05d2ebd0836 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:21.437623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:21.440315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:21.440610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:21.440915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] PATH_INFO: `/v3/users/e6deee9afb924aac95bf48b6d1317a22` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:21.442220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6deee9afb924aac95bf48b6d1317a22)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:21.444226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:21.664254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6deee9afb924aac95bf48b6d1317a22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.665002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6deee9afb924aac95bf48b6d1317a22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.684104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6deee9afb924aac95bf48b6d1317a22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.691480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6deee9afb924aac95bf48b6d1317a22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.837250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87cd49a7-7294-4725-a828-e6ceb0ef6846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6deee9afb924aac95bf48b6d1317a22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.843922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1157/2251] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:21 2022] DELETE /identity/v3/users/e6deee9afb924aac95bf48b6d1317a22 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:22.119650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.127195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:22.144058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bd74b-d2a6-49e6-8b23-bee0052306a1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.207560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.208477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.208793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.209242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] PATH_INFO: `/v3/projects/e738529494cc4721a5049a9ea08f30f0` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.211515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e738529494cc4721a5049a9ea08f30f0)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.214023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:22.355107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:22.357273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e738529494cc4721a5049a9ea08f30f0', 'request_id': 'req-633d9524-58ba-4832-8db6-61687f6e6964'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.364722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e738529494cc4721a5049a9ea08f30f0', 'request_id': 'req-633d9524-58ba-4832-8db6-61687f6e6964'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.374810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e738529494cc4721a5049a9ea08f30f0', 'request_id': 'req-633d9524-58ba-4832-8db6-61687f6e6964'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.447831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] The token cache is being invalidate because project e738529494cc4721a5049a9ea08f30f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:22.448121 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.448739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-633d9524-58ba-4832-8db6-61687f6e6964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.450391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1095/2252] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:22 2022] DELETE /identity/v3/projects/e738529494cc4721a5049a9ea08f30f0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:22.455821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.456346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.459780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.486011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:22.487084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:22.554830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1158/2253] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:22.562628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.562918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.563202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.584029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:22.585384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:22.596313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1096/2254] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:22.601110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.606188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:22.611524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebec757-2e86-4bb6-a0e4-943c3048ef1b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.616798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.617553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.617910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.618291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.619163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:22.619531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.621149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:22.635836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1159/2255] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:22.640239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.650965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0f01-3a3a-4106-bdd5-78c55a4c11ce None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.656065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.656727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.657013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.657294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.658169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.661843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:22.804089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1097/2256] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:22.805585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.817354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693fbc9-5758-4ac9-b6e7-dbb755b9d903 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.878104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.878853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.879138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.879416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.880290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.882690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.010197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1160/2257] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:23.013116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.025833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf195f-36e1-4770-b725-814401b0e747 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.030463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.033211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.033211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.033211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.033211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.034253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.046032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1098/2258] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:23.050183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.060973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f4f72-dfe6-4967-9bf3-0a9d52da3765 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.065719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08090-d463-4cfe-9a7e-e5b5f74cc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.066410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08090-d463-4cfe-9a7e-e5b5f74cc3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.066722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08090-d463-4cfe-9a7e-e5b5f74cc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.067579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08090-d463-4cfe-9a7e-e5b5f74cc3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.068364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08090-d463-4cfe-9a7e-e5b5f74cc3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.070087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08090-d463-4cfe-9a7e-e5b5f74cc3a2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.080307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1161/2259] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:23.088073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.097985 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed77d-20c6-4027-91a2-4b306222216c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.102738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.104166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.104166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.104406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] PATH_INFO: `/v3/projects/83a03161442441709f2144280564023d/users/3feacc6e6be84fb1bee61cc529af0715/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.120005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a03161442441709f2144280564023d, user_id=3feacc6e6be84fb1bee61cc529af0715, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.123017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.214600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1099/2260] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:23 2022] PUT /identity/v3/projects/83a03161442441709f2144280564023d/users/3feacc6e6be84fb1bee61cc529af0715/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:23.225972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.226391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.226682 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.255206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] MFA Rules not processed for user `3feacc6e6be84fb1bee61cc529af0715`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:23.256747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:23.328605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1162/2261] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:23.333851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.402187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941aa04-f1b7-46f7-abbf-3c0f65ed0404 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.407539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.408224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.408544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.408859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.409585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.411727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.507981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1100/2262] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:23.511991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.523229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ad96a-bd46-4c25-84fb-12eff27dad2d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.577478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:23.583647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.587527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.587527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.587527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.587527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.587527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.689607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1163/2263] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:23.694193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.705169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4bcf-d510-4317-8c86-51f1a67bbfc7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.710598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.711258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.711549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.711826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.712555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.714207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.725739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1101/2264] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:23.729910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.740180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da799d-ab09-44f3-802a-1f44af1c5218 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.745251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.746182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.746471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.746750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] PATH_INFO: `/v3/projects/30a149a1a66f48ef82af768d6fc22bac/users/2608660cd995463fa2293a952c801a28/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.762028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a149a1a66f48ef82af768d6fc22bac, user_id=2608660cd995463fa2293a952c801a28, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.764794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.860743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1164/2265] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:23 2022] PUT /identity/v3/projects/30a149a1a66f48ef82af768d6fc22bac/users/2608660cd995463fa2293a952c801a28/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:23.864741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.875314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c7438-3219-48a2-80cd-dfcb9dd133ad admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.923459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:23.936679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43634-9f87-4299-aedf-dcdc51e77286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.942530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43634-9f87-4299-aedf-dcdc51e77286 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.942530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43634-9f87-4299-aedf-dcdc51e77286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.942530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43634-9f87-4299-aedf-dcdc51e77286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.942530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43634-9f87-4299-aedf-dcdc51e77286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.942530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43634-9f87-4299-aedf-dcdc51e77286 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.951507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1102/2266] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:23.957482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.968397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca862ea-15e8-4ddc-87c2-9004bc6ce35a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.973822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.974926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.975283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.975795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] PATH_INFO: `/v3/projects/30a149a1a66f48ef82af768d6fc22bac/users/2608660cd995463fa2293a952c801a28/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.978461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a149a1a66f48ef82af768d6fc22bac, user_id=2608660cd995463fa2293a952c801a28, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.981673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.993629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1165/2267] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:23 2022] PUT /identity/v3/projects/30a149a1a66f48ef82af768d6fc22bac/users/2608660cd995463fa2293a952c801a28/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:24.005011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.005294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.011517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.034501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] MFA Rules not processed for user `2608660cd995463fa2293a952c801a28`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:24.036317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:24.110074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1103/2268] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:24.122387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.124417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:24.186808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be309a-d96f-45c3-b2df-5885dd5d793c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.190587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219590a-58ae-4c9e-b295-0a6efb19de6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.191252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219590a-58ae-4c9e-b295-0a6efb19de6d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.191541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219590a-58ae-4c9e-b295-0a6efb19de6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.191855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219590a-58ae-4c9e-b295-0a6efb19de6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.252642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219590a-58ae-4c9e-b295-0a6efb19de6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.254140 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219590a-58ae-4c9e-b295-0a6efb19de6d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.263320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1166/2269] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:26.689311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:26.690775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:26.762256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87bd8e-b996-4fb9-aa5e-e869a1e5f383 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:26.767237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:26.768108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.768396 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.768675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] PATH_INFO: `/v3/users/8cf212e796d7426d93d799ef723b7a69` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.770554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf212e796d7426d93d799ef723b7a69)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:26.772506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:26.951380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf212e796d7426d93d799ef723b7a69'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.966925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf212e796d7426d93d799ef723b7a69'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.976131 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:27.031445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf212e796d7426d93d799ef723b7a69'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.039107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf212e796d7426d93d799ef723b7a69'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.039760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf212e796d7426d93d799ef723b7a69'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.046203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1104/2270] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:26 2022] DELETE /identity/v3/users/8cf212e796d7426d93d799ef723b7a69 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:27.050768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6775d-3642-4805-82a9-383adba37336 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.051214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6775d-3642-4805-82a9-383adba37336 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.051341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6775d-3642-4805-82a9-383adba37336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.069593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-50f6775d-3642-4805-82a9-383adba37336 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:27.070993 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50f6775d-3642-4805-82a9-383adba37336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:27.132650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1167/2271] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:27.142339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:27.143941 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:27.203344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69079a5-4f6b-45e6-8f79-d2d613a24284 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:27.206989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:27.207661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.207950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.208229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.217161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:27.218664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:27.228100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1105/2272] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:27.742617 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6775d-3642-4805-82a9-383adba37336 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:27.744130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50f6775d-3642-4805-82a9-383adba37336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:27.752912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:27.756754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6775d-3642-4805-82a9-383adba37336 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:27.761700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:27.762638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.762924 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.763221 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] PATH_INFO: `/v3/projects/23dc4a0377a344f5ba786bef3e9c1626` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.764457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dc4a0377a344f5ba786bef3e9c1626)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:27.766483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:27.872339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dc4a0377a344f5ba786bef3e9c1626', 'request_id': 'req-7131f44a-65b8-485f-a961-14b11f0317c3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.940260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dc4a0377a344f5ba786bef3e9c1626', 'request_id': 'req-7131f44a-65b8-485f-a961-14b11f0317c3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.947870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dc4a0377a344f5ba786bef3e9c1626', 'request_id': 'req-7131f44a-65b8-485f-a961-14b11f0317c3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.958923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] The token cache is being invalidate because project 23dc4a0377a344f5ba786bef3e9c1626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:27.959272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.959871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:27.966174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1168/2273] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:27 2022] DELETE /identity/v3/projects/23dc4a0377a344f5ba786bef3e9c1626 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:30.649530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:30.650970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:30.736628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25048e21-4062-449d-b085-8463c6047630 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:30.786935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:30.787633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:30.787866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:30.788222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:30.789969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:30.836629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:30.859351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:30.861713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3380d1-376f-4f87-8884-d4158c77b4ef service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:30.873545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1106/2274] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:37.779843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:37.781250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:37.847456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f44a-65b8-485f-a961-14b11f0317c3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:37.852724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:37.853594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:37.853874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:37.854185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] PATH_INFO: `/v3/users/3feacc6e6be84fb1bee61cc529af0715` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:37.855360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3feacc6e6be84fb1bee61cc529af0715)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:37.857272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:38.090310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3feacc6e6be84fb1bee61cc529af0715'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.091083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3feacc6e6be84fb1bee61cc529af0715'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.104462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3feacc6e6be84fb1bee61cc529af0715'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.128831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3feacc6e6be84fb1bee61cc529af0715'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.208840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3feacc6e6be84fb1bee61cc529af0715'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.215433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1169/2275] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:37 2022] DELETE /identity/v3/users/3feacc6e6be84fb1bee61cc529af0715 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:38.219939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:38.220411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:38.220709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:38.238130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:38.239380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:38.304171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1107/2276] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:38.313915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:38.315480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:38.325257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:38.374092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189493-6d6c-4287-8a37-328543b865ae admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:38.377910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:38.378624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:38.378909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:38.379189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:38.388748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:38.390292 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:38.400962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1170/2277] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:38.844209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:38.845679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:38.858051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323cc00-23f6-444e-aaab-3e576dfa8877 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:38.862860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:38.863724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:38.864005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:38.864286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] PATH_INFO: `/v3/projects/83a03161442441709f2144280564023d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:38.865484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a03161442441709f2144280564023d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:38.874846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:38.992001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a03161442441709f2144280564023d', 'request_id': 'req-5f7cf75c-5145-4cad-8bda-85ec17bda177'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.998290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a03161442441709f2144280564023d', 'request_id': 'req-5f7cf75c-5145-4cad-8bda-85ec17bda177'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.003809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a03161442441709f2144280564023d', 'request_id': 'req-5f7cf75c-5145-4cad-8bda-85ec17bda177'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.128487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] The token cache is being invalidate because project 83a03161442441709f2144280564023d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:39.128785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.129533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.131846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1108/2278] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:38 2022] DELETE /identity/v3/projects/83a03161442441709f2144280564023d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:39.148031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.157815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d667ea-9051-4318-b4be-dc3ab18bc3c2 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.215933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.216802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.218134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.218134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] PATH_INFO: `/v3/users/2608660cd995463fa2293a952c801a28` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.218689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2608660cd995463fa2293a952c801a28)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.220672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.415650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2608660cd995463fa2293a952c801a28'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.419757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2608660cd995463fa2293a952c801a28'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.428584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2608660cd995463fa2293a952c801a28'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.435833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2608660cd995463fa2293a952c801a28'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.482181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b739ead-9b8e-40d6-b069-dce7a7a9c747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2608660cd995463fa2293a952c801a28'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:39.488299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1171/2279] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:39 2022] DELETE /identity/v3/users/2608660cd995463fa2293a952c801a28 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:39.998641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.001387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:40.017336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cf75c-5145-4cad-8bda-85ec17bda177 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.076958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.077882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.078207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.079101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] PATH_INFO: `/v3/projects/30a149a1a66f48ef82af768d6fc22bac` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.079787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a149a1a66f48ef82af768d6fc22bac)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.081775 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.083402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:40.237197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a149a1a66f48ef82af768d6fc22bac', 'request_id': 'req-82f0b03d-59e7-440a-83ae-efb673520bb1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:40.243581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a149a1a66f48ef82af768d6fc22bac', 'request_id': 'req-82f0b03d-59e7-440a-83ae-efb673520bb1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:40.249376 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a149a1a66f48ef82af768d6fc22bac', 'request_id': 'req-82f0b03d-59e7-440a-83ae-efb673520bb1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:40.351174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] The token cache is being invalidate because project 30a149a1a66f48ef82af768d6fc22bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:40.351540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:40.352161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82f0b03d-59e7-440a-83ae-efb673520bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:40.353750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1109/2280] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:39 2022] DELETE /identity/v3/projects/30a149a1a66f48ef82af768d6fc22bac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:40.359626 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.360058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.360265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.378265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:40.379513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:40.410315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:40.458031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1172/2281] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:40.466310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.466558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.466840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.485797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:40.487046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:40.495920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1110/2282] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:40.499856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.510991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3aaac-ba36-45ac-b7a6-1561951f0206 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.516236 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.517745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.517745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.517745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.518354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:40.518663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.522020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.534205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1173/2283] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:40.539291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.548594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0179-0b20-4ec9-b5f7-bb3c0e235e80 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.553972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.554644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.554927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.555204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.555902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.557819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.706834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1111/2284] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:40.711636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.722133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2ab2-a3c2-4aee-9f26-102c22fdfb96 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.780281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae476-4218-4212-9108-51395886282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.780872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae476-4218-4212-9108-51395886282d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.781161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae476-4218-4212-9108-51395886282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.781441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae476-4218-4212-9108-51395886282d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.782182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ae476-4218-4212-9108-51395886282d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.784114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ae476-4218-4212-9108-51395886282d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.854960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1174/2285] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:40.859061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.869326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c996fc8-57b4-4226-b168-b637d964d136 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.874022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.874671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.874954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.875251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.875947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.877554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.887762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1112/2286] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:40.891653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae476-4218-4212-9108-51395886282d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.902086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae476-4218-4212-9108-51395886282d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.906767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa39fe-ce6c-4472-b22f-7e1ea8f19a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.907416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa39fe-ce6c-4472-b22f-7e1ea8f19a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.907705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa39fe-ce6c-4472-b22f-7e1ea8f19a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.907987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa39fe-ce6c-4472-b22f-7e1ea8f19a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.908713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa39fe-ce6c-4472-b22f-7e1ea8f19a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.910459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa39fe-ce6c-4472-b22f-7e1ea8f19a8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.920704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1175/2287] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:40.924569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.934762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14942a9-3651-48f5-a274-5cc0222f8c84 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.939370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.940225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.940509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.940787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] PATH_INFO: `/v3/projects/b0c03268bfb84da9838a846d78db543d/users/827d0ad3248c4f42bffe5ae15495f841/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.956726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c03268bfb84da9838a846d78db543d, user_id=827d0ad3248c4f42bffe5ae15495f841, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.960503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:41.013617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1113/2288] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:40 2022] PUT /identity/v3/projects/b0c03268bfb84da9838a846d78db543d/users/827d0ad3248c4f42bffe5ae15495f841/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:41.031616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:41.031848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:41.032162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:41.059378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] MFA Rules not processed for user `827d0ad3248c4f42bffe5ae15495f841`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:41.060734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:41.124560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1176/2289] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:41.136066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:41.137747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:41.194694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07e61-84bd-4252-9dc8-d4518a61c5eb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:41.198426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993fdb-bc9b-4db9-8ac8-c49c8d49cad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:41.199071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993fdb-bc9b-4db9-8ac8-c49c8d49cad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:41.199372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993fdb-bc9b-4db9-8ac8-c49c8d49cad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:41.199843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993fdb-bc9b-4db9-8ac8-c49c8d49cad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:41.208621 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd993fdb-bc9b-4db9-8ac8-c49c8d49cad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:41.210109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd993fdb-bc9b-4db9-8ac8-c49c8d49cad7 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:41.220894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1114/2290] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:46.713652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:46.743414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:46.779833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26c2d-c249-4c6f-90f7-e6f88b713892 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:46.784457 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:46.785333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:46.785621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:46.785903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] PATH_INFO: `/v3/users/827d0ad3248c4f42bffe5ae15495f841` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:46.787684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827d0ad3248c4f42bffe5ae15495f841)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:46.789653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:47.054847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827d0ad3248c4f42bffe5ae15495f841'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:47.054847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827d0ad3248c4f42bffe5ae15495f841'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:47.069373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827d0ad3248c4f42bffe5ae15495f841'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:47.077184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827d0ad3248c4f42bffe5ae15495f841'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:47.179840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827d0ad3248c4f42bffe5ae15495f841'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:47.186949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1177/2291] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:46 2022] DELETE /identity/v3/users/827d0ad3248c4f42bffe5ae15495f841 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:47.191486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:47.191956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:47.192046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:47.212860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:47.214140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:47.242043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:47.278476 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1115/2292] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:47.288016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:47.289602 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:47.359028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aedbf-8b98-4b19-b63c-c8bd007a1b76 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:47.363100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955794-0e93-4854-9f2b-2672fe5f44f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:47.363720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955794-0e93-4854-9f2b-2672fe5f44f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:47.364001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955794-0e93-4854-9f2b-2672fe5f44f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:47.364277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955794-0e93-4854-9f2b-2672fe5f44f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:47.374414 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955794-0e93-4854-9f2b-2672fe5f44f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:47.376217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955794-0e93-4854-9f2b-2672fe5f44f7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:47.387511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1178/2293] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:47.987587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:47.989128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.003462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac66d-9f4e-4259-86db-e9af3791498e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.010408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.013137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.013664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.014150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] PATH_INFO: `/v3/projects/b0c03268bfb84da9838a846d78db543d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.017968 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c03268bfb84da9838a846d78db543d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.020130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:48.137982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c03268bfb84da9838a846d78db543d', 'request_id': 'req-68964aa8-0d97-4160-b4e6-65810ad78b3f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.144717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c03268bfb84da9838a846d78db543d', 'request_id': 'req-68964aa8-0d97-4160-b4e6-65810ad78b3f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.151831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c03268bfb84da9838a846d78db543d', 'request_id': 'req-68964aa8-0d97-4160-b4e6-65810ad78b3f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.236480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] The token cache is being invalidate because project b0c03268bfb84da9838a846d78db543d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:48.237081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.237575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68964aa8-0d97-4160-b4e6-65810ad78b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.239379 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1116/2294] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:47 2022] DELETE /identity/v3/projects/b0c03268bfb84da9838a846d78db543d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:48.244239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.244673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.244805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.263349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:48.264583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.309149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:48.326839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1179/2295] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:48.335767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.336053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.336330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.357520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:48.358786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.369657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1117/2296] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:48.371200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.382528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997a8f-58e3-4341-bbef-ca8ebe881c7a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.387838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.389239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.389599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.389955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.390808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:48.391190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.393181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:48.419211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.431477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1180/2297] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:48.431632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.437016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.437573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a984ad-08cc-4535-867f-cbfebc4c0975 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.445066 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.445964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.446285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.447128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] PATH_INFO: `/v3/users/48f196295bdf4ac99f20494e2b5b4890` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.448165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f196295bdf4ac99f20494e2b5b4890)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.451464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:48.454340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7c02-f63c-4002-999b-948d45b008c0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.461967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.462752 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.463109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.463461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.464506 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.468422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:48.606267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1181/2298] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:48 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:48.610715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.666829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f196295bdf4ac99f20494e2b5b4890'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.694931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f196295bdf4ac99f20494e2b5b4890'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.698494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a234-0ca9-4103-9622-e2e0ce8c8517 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.704129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.704763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.705068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.705330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.706052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.709171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:48.770170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f196295bdf4ac99f20494e2b5b4890'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.781184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f196295bdf4ac99f20494e2b5b4890'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.782142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c52d0f3a-671b-4e3b-bbaa-6a9c06e17915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f196295bdf4ac99f20494e2b5b4890'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:48.789086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1118/2299] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:48 2022] DELETE /identity/v3/users/48f196295bdf4ac99f20494e2b5b4890 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:48.793524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.793822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.794549 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.815536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:48.818195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.824588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1182/2300] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:48 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:48.831073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.834437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.843427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:48.857102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83455f11-c6b2-4ac5-89d4-797c1b614151 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.921691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1119/2301] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:48.930296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.933297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:48.953801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.954526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.954814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.955087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.955973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.957600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:48.970039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1183/2302] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:48.971820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:48.981702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaaed5-1b5f-4976-8473-fa7ef8d49e80 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:48.986947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:48.987596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:48.987880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:48.988157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:48.988870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:48.991497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.001961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1184/2303] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:49.003508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc952af-8f47-4303-967b-821a620b2d20 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.006942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.008685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9688df3-59ac-458e-9a9c-09369fc0e909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.009450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9688df3-59ac-458e-9a9c-09369fc0e909 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.009811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9688df3-59ac-458e-9a9c-09369fc0e909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.010196 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9688df3-59ac-458e-9a9c-09369fc0e909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.017473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc468dc-039c-4dde-adb8-2d7309263582 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.021430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9688df3-59ac-458e-9a9c-09369fc0e909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.023056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9688df3-59ac-458e-9a9c-09369fc0e909 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.023967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.025117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.025532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.025845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] PATH_INFO: `/v3/projects/39dbdd0bfb6c47568aa6c57e0f536ec7/users/2d65982c71154972accd0e49809e0bf9/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.034975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1120/2304] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:49.042991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dbdd0bfb6c47568aa6c57e0f536ec7, user_id=2d65982c71154972accd0e49809e0bf9, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.045779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.101662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1185/2305] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:49 2022] PUT /identity/v3/projects/39dbdd0bfb6c47568aa6c57e0f536ec7/users/2d65982c71154972accd0e49809e0bf9/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:49.113171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.113455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.113763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.150588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] MFA Rules not processed for user `2d65982c71154972accd0e49809e0bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:49.151814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:49.233283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1121/2306] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:49.234928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.253718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:49.326024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c403e2-7e47-4238-8b47-8c17bacf82c1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.330958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.331751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.332045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.332326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.333106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.335069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.424699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1186/2307] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:49 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:49.429380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.441233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eda830-5269-48bd-a58f-64842119dd37 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.484117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.485890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:49.504819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:49.518639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.518938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.519287 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.522153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.522153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.522603 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.575485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93aaf-7133-429e-8463-bb49c48017c2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.580561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.581566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.582019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.582424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] PATH_INFO: `/v3/projects/0afacd93a50f460fafbcb75b93a85ba5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.583836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afacd93a50f460fafbcb75b93a85ba5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.585861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.729427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1122/2308] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:49 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:49.729427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.738819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1ddc9-6795-4c83-8af3-d9ba2eabc211 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.747685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.747685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.747685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.747685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.748087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.748087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.758158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1123/2309] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:49.762110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.772745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604197-ab90-44ae-ab0f-bd75bccab05d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.777339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.778149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.778472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.778860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.779682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.781282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.794980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1124/2310] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:49.799074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.809871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c57233-c84a-4076-b547-dc80eed2d7c2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.814764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8566b6-afac-4f2d-accd-ffcf3a872cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.815659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8566b6-afac-4f2d-accd-ffcf3a872cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.815981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8566b6-afac-4f2d-accd-ffcf3a872cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.816258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8566b6-afac-4f2d-accd-ffcf3a872cc2 admin admin] PATH_INFO: `/v3/projects/a10c047732f04d09ab6af94c0827b697/users/74cb47d854684a77909eaa54f14cb94f/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.831956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8566b6-afac-4f2d-accd-ffcf3a872cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10c047732f04d09ab6af94c0827b697, user_id=74cb47d854684a77909eaa54f14cb94f, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.834671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8566b6-afac-4f2d-accd-ffcf3a872cc2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.301583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1125/2311] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:49 2022] PUT /identity/v3/projects/a10c047732f04d09ab6af94c0827b697/users/74cb47d854684a77909eaa54f14cb94f/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:50.310731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afacd93a50f460fafbcb75b93a85ba5', 'request_id': 'req-0de36e04-d2fc-4c72-bda1-28de96bffdf4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:50.313122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.313477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.313821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.340829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] MFA Rules not processed for user `74cb47d854684a77909eaa54f14cb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:50.342087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:50.385278 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afacd93a50f460fafbcb75b93a85ba5', 'request_id': 'req-0de36e04-d2fc-4c72-bda1-28de96bffdf4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:50.392541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afacd93a50f460fafbcb75b93a85ba5', 'request_id': 'req-0de36e04-d2fc-4c72-bda1-28de96bffdf4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:50.404996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] The token cache is being invalidate because project 0afacd93a50f460fafbcb75b93a85ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:50.405368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:50.406094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0de36e04-d2fc-4c72-bda1-28de96bffdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:50.407862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1187/2312] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:49 2022] DELETE /identity/v3/projects/0afacd93a50f460fafbcb75b93a85ba5 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:50.408003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1126/2313] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:50.413354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85cf21-a11c-4388-a558-1ed4e8b998f5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.413652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85cf21-a11c-4388-a558-1ed4e8b998f5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.413939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85cf21-a11c-4388-a558-1ed4e8b998f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.415812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.437703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2a85cf21-a11c-4388-a558-1ed4e8b998f5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:50.439158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a85cf21-a11c-4388-a558-1ed4e8b998f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:50.451961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:50.483964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d955f-fab1-4710-845c-19de15629ad7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.489200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.489903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.490341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.490627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.491335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.493754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.514962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1188/2314] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:50.523247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.523663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.523953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.543178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:50.545527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:50.552861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1189/2315] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:50.556706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.565701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ef39a-b495-40cb-8cda-a6cb5fbb338c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.571340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.571972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.572261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.572541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.573256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:50.573577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.575207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.587100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1190/2316] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:30:50.594230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.604246 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f04ce-4925-4c9b-9bbf-8687de1ec028 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.609125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.609869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.610275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.610641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.611328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.613213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.629013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1127/2317] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:50.634647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.636434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:50.646707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:50.698759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd286f-0617-42c5-9fdb-ef8b0ccbd47b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.703444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.704101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.704385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.704659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.705333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.707309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.775780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1191/2318] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/projects => generated 399 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:50.779726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.825687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1128/2319] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:50.825687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.828908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c478d-d135-476c-9908-fa1ffaef367a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.842245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46e8c3-45c6-44fd-b7e1-4355de4c6d5b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.846937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.847611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.847895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.848174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.849380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.851342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.887169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.887862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.888185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.888531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.889336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.890974 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.901203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1129/2320] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:50.905209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.917429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a801-84f9-4541-a8a2-4ea0ea3df776 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.922243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.923102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.923383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.923658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] PATH_INFO: `/v3/projects/185cbf67e188428782e4ff9a2735b398/users/e1ec162e9fba4171a57a3fbb4a19fbb4/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.939661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=185cbf67e188428782e4ff9a2735b398, user_id=e1ec162e9fba4171a57a3fbb4a19fbb4, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.940241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1192/2321] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:50 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:50.942648 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.944346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.954097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf4af-11e1-4628-a9a4-a08fd764dd9a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.958645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.959282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.962898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.962898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.962898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.962898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:50.971927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1193/2322] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:50.976220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.985641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111ed4-cd6f-458d-87d8-db0659fc20c0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:50.990872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:50.991492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:50.991777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:50.992058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:50.992788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:50.994373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.005787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1194/2323] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:51.009544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:51.019480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691312-611b-40f3-927f-72730afdfbb2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.024578 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb68ee-27d3-467b-a631-aa2d7c8bc329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.025477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb68ee-27d3-467b-a631-aa2d7c8bc329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.025757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb68ee-27d3-467b-a631-aa2d7c8bc329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.026067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb68ee-27d3-467b-a631-aa2d7c8bc329 admin admin] PATH_INFO: `/v3/projects/85ce74d3815c47718ebe5db4cc6a18aa/users/fa4b289321f54201ad265e33df1b6a7c/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.037987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1130/2324] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:50 2022] PUT /identity/v3/projects/185cbf67e188428782e4ff9a2735b398/users/e1ec162e9fba4171a57a3fbb4a19fbb4/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:51.042761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:51.043056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb68ee-27d3-467b-a631-aa2d7c8bc329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ce74d3815c47718ebe5db4cc6a18aa, user_id=fa4b289321f54201ad265e33df1b6a7c, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.045749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb68ee-27d3-467b-a631-aa2d7c8bc329 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.105225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5258c-ddcc-4cf5-89f7-0e71ae6c25cd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.110503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.111328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.111450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.111712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.112433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.114144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.125524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1131/2325] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:51.132247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:51.143665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b8e96-edc4-4f99-9320-0f4aeedd3269 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.147404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1195/2326] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:51 2022] PUT /identity/v3/projects/85ce74d3815c47718ebe5db4cc6a18aa/users/fa4b289321f54201ad265e33df1b6a7c/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:51.149752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:51.158477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.158762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.159043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.190549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] MFA Rules not processed for user `fa4b289321f54201ad265e33df1b6a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:51.191893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.203041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:51.211342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ba68-9489-4779-9406-53b5b4c610e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.212361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ba68-9489-4779-9406-53b5b4c610e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.212754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ba68-9489-4779-9406-53b5b4c610e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.213096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ba68-9489-4779-9406-53b5b4c610e6 admin admin] PATH_INFO: `/v3/projects/185cbf67e188428782e4ff9a2735b398/users/e1ec162e9fba4171a57a3fbb4a19fbb4/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.215229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ba68-9489-4779-9406-53b5b4c610e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185cbf67e188428782e4ff9a2735b398, user_id=e1ec162e9fba4171a57a3fbb4a19fbb4, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.218176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ba68-9489-4779-9406-53b5b4c610e6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.229126 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1132/2327] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:51 2022] PUT /identity/v3/projects/185cbf67e188428782e4ff9a2735b398/users/e1ec162e9fba4171a57a3fbb4a19fbb4/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:51.239762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.240171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.240669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.269734 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1196/2328] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:51.271721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] MFA Rules not processed for user `e1ec162e9fba4171a57a3fbb4a19fbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:51.275290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.281746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:51.283202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.346480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1133/2329] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:51.353182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718b6f4-801c-4ba3-9347-fa9d20ed266e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.358392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:51.359680 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.403307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.403959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.404238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.404511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.417755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df4381-9476-4256-b94b-b9844c1ecc4f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.421597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.422409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.422691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.422988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.424852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.470079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.471639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.472189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:51.482146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1197/2330] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:51.492575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.494104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.503605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1134/2331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:53.719647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:53.728707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e157b0-bcea-4be3-8940-7c76e63a7b72 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:53.732512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:53.733291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:53.733674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:53.734044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:53.735910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:53.755412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:53.800985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:53.803031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:53.812293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1198/2332] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:55.747524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:55.756659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea845-8966-4370-be40-bdc399ab882d service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:55.760658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5371e-394c-475d-88cc-5152bc7c4730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:55.760994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5371e-394c-475d-88cc-5152bc7c4730 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:55.761274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5371e-394c-475d-88cc-5152bc7c4730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:55.761548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5371e-394c-475d-88cc-5152bc7c4730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:55.770478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5371e-394c-475d-88cc-5152bc7c4730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:55.771906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5371e-394c-475d-88cc-5152bc7c4730 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:55.781520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1135/2333] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:58.798923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:58.871982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb31ba-a5f2-4e2e-8a37-9ea5b4ee9d32 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:58.876835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:58.877716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:58.878021 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:58.878313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] PATH_INFO: `/v3/users/fa4b289321f54201ad265e33df1b6a7c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:58.879550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4b289321f54201ad265e33df1b6a7c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:58.882124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:59.233896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4b289321f54201ad265e33df1b6a7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:59.234577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4b289321f54201ad265e33df1b6a7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:59.247635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4b289321f54201ad265e33df1b6a7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:59.255215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4b289321f54201ad265e33df1b6a7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:59.368224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4b289321f54201ad265e33df1b6a7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:59.374770 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1199/2334] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:58 2022] DELETE /identity/v3/users/fa4b289321f54201ad265e33df1b6a7c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:59.379313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:59.379806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:59.379900 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:59.397660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:59.398913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:59.459745 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1136/2335] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:59.469299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:59.470738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:59.513427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:59.529086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7144b-f727-4d47-ac58-a6c1574f9aea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:59.532864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:59.533511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:59.533800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:59.534111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:59.543741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:59.547377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:59.554708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1200/2336] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:00.124093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:00.125444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:00.140207 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c410-7414-49df-a43d-37bf187b29b5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:00.158533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:00.159362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:00.159802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:00.160109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] PATH_INFO: `/v3/projects/85ce74d3815c47718ebe5db4cc6a18aa` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:00.161840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ce74d3815c47718ebe5db4cc6a18aa)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:00.164298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:00.331902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ce74d3815c47718ebe5db4cc6a18aa', 'request_id': 'req-12bcd07f-a1db-4389-965a-58c7003a3de0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:00.338978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ce74d3815c47718ebe5db4cc6a18aa', 'request_id': 'req-12bcd07f-a1db-4389-965a-58c7003a3de0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:00.345713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ce74d3815c47718ebe5db4cc6a18aa', 'request_id': 'req-12bcd07f-a1db-4389-965a-58c7003a3de0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:00.437048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] The token cache is being invalidate because project 85ce74d3815c47718ebe5db4cc6a18aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:00.437742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:00.437955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12bcd07f-a1db-4389-965a-58c7003a3de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:00.439574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1137/2337] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:00 2022] DELETE /identity/v3/projects/85ce74d3815c47718ebe5db4cc6a18aa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:01.713396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:01.714905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:01.727621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11b4cf-5f95-4b0a-bd00-f77352b8804e service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:01.786067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:01.786980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:01.787265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:01.787542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] PATH_INFO: `/v3/users/2d65982c71154972accd0e49809e0bf9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:01.788750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d65982c71154972accd0e49809e0bf9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:01.790765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:01.939402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d65982c71154972accd0e49809e0bf9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:01.940101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d65982c71154972accd0e49809e0bf9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:01.952843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d65982c71154972accd0e49809e0bf9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:01.959790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d65982c71154972accd0e49809e0bf9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:02.037963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d65982c71154972accd0e49809e0bf9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:02.045391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1201/2338] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:01 2022] DELETE /identity/v3/users/2d65982c71154972accd0e49809e0bf9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:02.049936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:02.050792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:02.051366 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:02.071932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:02.073518 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:02.129037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:02.143365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1138/2339] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:02.153756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:02.155254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:02.221257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23c88-9371-4602-92f0-8df4f48d2b07 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:02.225504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:02.226223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:02.226513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:02.226795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:02.237250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:02.238981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:02.250034 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1202/2340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:02.810623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:02.812072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:02.828213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f98676-9c7e-4ab2-999c-3714b3008df7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:02.833229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:02.834685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:02.834972 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:02.835252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] PATH_INFO: `/v3/projects/39dbdd0bfb6c47568aa6c57e0f536ec7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:02.841402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=39dbdd0bfb6c47568aa6c57e0f536ec7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:02.841402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:02.986414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39dbdd0bfb6c47568aa6c57e0f536ec7', 'request_id': 'req-eb2bcd3e-559f-4f77-acdc-d4765a432acb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:02.993256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39dbdd0bfb6c47568aa6c57e0f536ec7', 'request_id': 'req-eb2bcd3e-559f-4f77-acdc-d4765a432acb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:02.999140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39dbdd0bfb6c47568aa6c57e0f536ec7', 'request_id': 'req-eb2bcd3e-559f-4f77-acdc-d4765a432acb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.076496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] The token cache is being invalidate because project 39dbdd0bfb6c47568aa6c57e0f536ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:03.077117 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.077465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.079095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1139/2341] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:02 2022] DELETE /identity/v3/projects/39dbdd0bfb6c47568aa6c57e0f536ec7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:03.083257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:03.088251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:03.093508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aa974-1745-4c9a-8fc5-90aae44d7974 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:03.154315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:03.155229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:03.155515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:03.155792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] PATH_INFO: `/v3/users/74cb47d854684a77909eaa54f14cb94f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:03.157045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cb47d854684a77909eaa54f14cb94f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:03.159092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:03.383155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cb47d854684a77909eaa54f14cb94f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.383952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cb47d854684a77909eaa54f14cb94f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.396820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cb47d854684a77909eaa54f14cb94f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.404371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cb47d854684a77909eaa54f14cb94f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.460065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cb47d854684a77909eaa54f14cb94f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:03.466505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1203/2342] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:03 2022] DELETE /identity/v3/users/74cb47d854684a77909eaa54f14cb94f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:04.055279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:04.057137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:04.076783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bcd3e-559f-4f77-acdc-d4765a432acb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:04.147454 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:04.148496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:04.148782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:04.149062 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] PATH_INFO: `/v3/projects/a10c047732f04d09ab6af94c0827b697` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:04.150346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10c047732f04d09ab6af94c0827b697)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:04.152407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:04.299915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10c047732f04d09ab6af94c0827b697', 'request_id': 'req-35843008-4807-4c8b-9bff-0f9e6fa92cd4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.306727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10c047732f04d09ab6af94c0827b697', 'request_id': 'req-35843008-4807-4c8b-9bff-0f9e6fa92cd4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.313258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10c047732f04d09ab6af94c0827b697', 'request_id': 'req-35843008-4807-4c8b-9bff-0f9e6fa92cd4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.453592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] The token cache is being invalidate because project a10c047732f04d09ab6af94c0827b697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:04.453884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.454693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35843008-4807-4c8b-9bff-0f9e6fa92cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.456298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1140/2343] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:04 2022] DELETE /identity/v3/projects/a10c047732f04d09ab6af94c0827b697 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:04.460762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:04.461574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:04.465174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:04.465174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:04.465372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:04.469047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:04.475131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bf648-f7b7-4914-9af8-243e6c6ec265 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:04.480331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] MFA Rules not processed for user `23b06a7649c6454393290c5d8c7e4688`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:04.481622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:04.532713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:04.533590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:04.533876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:04.534191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] PATH_INFO: `/v3/users/e1ec162e9fba4171a57a3fbb4a19fbb4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:04.535405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ec162e9fba4171a57a3fbb4a19fbb4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:04.537383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:04.537864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1141/2344] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:04.561461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:04.813569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ec162e9fba4171a57a3fbb4a19fbb4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.814503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ec162e9fba4171a57a3fbb4a19fbb4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.828590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ec162e9fba4171a57a3fbb4a19fbb4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.836058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ec162e9fba4171a57a3fbb4a19fbb4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.916934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5522b38-fcb3-41fb-821d-1f2a1db05d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ec162e9fba4171a57a3fbb4a19fbb4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:04.923826 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1204/2345] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:04 2022] DELETE /identity/v3/users/e1ec162e9fba4171a57a3fbb4a19fbb4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:05.389144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:05.391092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:05.407282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe1fe-9186-4b33-b103-25309ec05573 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:05.467265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:05.468109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.468392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.468678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] PATH_INFO: `/v3/projects/185cbf67e188428782e4ff9a2735b398` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.469851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] RBAC: Authorizing `identity:delete_project(project_id=185cbf67e188428782e4ff9a2735b398)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:05.471812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:05.569175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185cbf67e188428782e4ff9a2735b398', 'request_id': 'req-b4a57d59-5d09-4cc1-8060-c2062edf164a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.575433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185cbf67e188428782e4ff9a2735b398', 'request_id': 'req-b4a57d59-5d09-4cc1-8060-c2062edf164a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.580807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185cbf67e188428782e4ff9a2735b398', 'request_id': 'req-b4a57d59-5d09-4cc1-8060-c2062edf164a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.758480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] The token cache is being invalidate because project 185cbf67e188428782e4ff9a2735b398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:05.758780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.759440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b4a57d59-5d09-4cc1-8060-c2062edf164a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.761212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1142/2346] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:05 2022] DELETE /identity/v3/projects/185cbf67e188428782e4ff9a2735b398 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:05.766322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.766784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.766923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.787165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:05.788380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:05.849238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1205/2347] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:05.857897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.858571 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.859040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.878751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:05.880041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:05.888248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1143/2348] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:05.892381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:05.902400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eebbb-861e-4db6-8e77-4b9ebef1bc00 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:05.907628 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:05.908420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.908792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.909613 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.910531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:31:05.910918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:05.913219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:05.925698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1206/2349] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:31:05.930905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:05.942026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c284f8-3102-4f15-8711-91947d2904f8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:05.947697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:05.948343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.948634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.948909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.949607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:05.951586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.090856 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1144/2350] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:05 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:06.095079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.106355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18cbc-7e52-4caa-88b3-6f66be9ba55d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.164016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.164689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.164997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.165262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.165968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.168055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.265973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1207/2351] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:06 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:06.270179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.281542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959bcd2-d2f2-4707-b1b9-11dafa02064f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.286246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.288709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.288994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.289271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.290022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.291653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.297933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:06.303682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1145/2352] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:06.307830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.318156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192801e-c032-400e-9e2c-00b62793e289 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.322831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f63a15-afb0-4221-b6b9-30827ad1c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.323490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f63a15-afb0-4221-b6b9-30827ad1c63a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.323784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f63a15-afb0-4221-b6b9-30827ad1c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.324067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f63a15-afb0-4221-b6b9-30827ad1c63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.324796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f63a15-afb0-4221-b6b9-30827ad1c63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.326455 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f63a15-afb0-4221-b6b9-30827ad1c63a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.337007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1208/2353] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:06.341106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.354334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7129c-8cbf-4916-a56d-14b2f7d4bda1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.359568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.360507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.360933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.361277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] PATH_INFO: `/v3/projects/7d5e7822359a4f0cb164630b5004f2cd/users/f8ce5a16ecd94b159eadb138c43ab3c9/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.376528 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5e7822359a4f0cb164630b5004f2cd, user_id=f8ce5a16ecd94b159eadb138c43ab3c9, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.379670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.500488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1146/2354] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:06 2022] PUT /identity/v3/projects/7d5e7822359a4f0cb164630b5004f2cd/users/f8ce5a16ecd94b159eadb138c43ab3c9/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:06.568719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.569013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.569300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.582284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:06.597121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] MFA Rules not processed for user `f8ce5a16ecd94b159eadb138c43ab3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:06.598448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.663196 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1209/2355] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:06.673707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.675598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.733836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6668b-6ac4-4481-8ddf-633ebc4dc3da admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.738446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.739129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.739481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.740388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.749311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.750960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.760218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1147/2356] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:06.883279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.884697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.981332 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad825b3-373c-4e5b-b8cd-5b8be430b4a2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.986607 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.987263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.987852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.988118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.989951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:07.004674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.006433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aae9ac-7f0e-4265-9907-2cf6822ede8c service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.016869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1210/2357] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:17.454281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:17.734365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=70 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:20.709099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:20.767855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1576-ac4c-440f-bfef-74daec444925 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:20.772487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:20.773351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:20.773637 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:20.773932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] PATH_INFO: `/v3/users/f8ce5a16ecd94b159eadb138c43ab3c9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:20.775139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ce5a16ecd94b159eadb138c43ab3c9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:20.777090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:21.265437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ce5a16ecd94b159eadb138c43ab3c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:21.284618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ce5a16ecd94b159eadb138c43ab3c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:21.383399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ce5a16ecd94b159eadb138c43ab3c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:21.394773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ce5a16ecd94b159eadb138c43ab3c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:21.396120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ce5a16ecd94b159eadb138c43ab3c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:21.407159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1148/2358] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:20 2022] DELETE /identity/v3/users/f8ce5a16ecd94b159eadb138c43ab3c9 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:21.407954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bb1c6-82b2-498d-a903-f2b16f9ce7a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:21.408443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bb1c6-82b2-498d-a903-f2b16f9ce7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:21.408532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bb1c6-82b2-498d-a903-f2b16f9ce7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:21.437960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4a3bb1c6-82b2-498d-a903-f2b16f9ce7a7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:21.439367 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4a3bb1c6-82b2-498d-a903-f2b16f9ce7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:21.531998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1211/2359] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:21.541742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:21.543223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:21.605825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083037d-3ea0-4d0c-9e95-606d266b6f96 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:21.609978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:21.610873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:21.611161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:21.611438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:21.621597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:21.623287 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:21.635194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1149/2360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:21.714110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfe19a-0091-40b8-90d0-8db68195d371 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:21.714441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfe19a-0091-40b8-90d0-8db68195d371 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:21.715662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfe19a-0091-40b8-90d0-8db68195d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:21.742315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4dbfe19a-0091-40b8-90d0-8db68195d371 None None] MFA Rules not processed for user `f023004fda46413e878274519d68197c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:21.743554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4dbfe19a-0091-40b8-90d0-8db68195d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:21.807886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1212/2361] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:22.079230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:22.081012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:22.099228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e58bfb-23fc-4c50-a9e5-cf7b7013f557 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:22.110052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:22.111762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:22.112053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:22.112336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] PATH_INFO: `/v3/projects/7d5e7822359a4f0cb164630b5004f2cd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:22.113725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5e7822359a4f0cb164630b5004f2cd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:22.117288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:22.140535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:22.258855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5e7822359a4f0cb164630b5004f2cd', 'request_id': 'req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:22.266523 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5e7822359a4f0cb164630b5004f2cd', 'request_id': 'req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:22.282576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5e7822359a4f0cb164630b5004f2cd', 'request_id': 'req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:22.374717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] The token cache is being invalidate because project 7d5e7822359a4f0cb164630b5004f2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:22.379013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:22.379013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:22.379013 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1150/2362] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:22 2022] DELETE /identity/v3/projects/7d5e7822359a4f0cb164630b5004f2cd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:31.795135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=52 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:32.371085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:38.648228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b6c4-62da-4baf-a2cd-bf4bce1816e2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:38.652150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b6c4-62da-4baf-a2cd-bf4bce1816e2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:38.652150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b6c4-62da-4baf-a2cd-bf4bce1816e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:38.707746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f625b6c4-62da-4baf-a2cd-bf4bce1816e2 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:38.709542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f625b6c4-62da-4baf-a2cd-bf4bce1816e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:38.782435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1213/2363] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:38.821962 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:38.823458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:38.913185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad6ce1-4038-4b28-ad28-8ed3eb537685 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:38.918556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06807bb-380c-4a17-adca-245e02ee8c62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:38.919198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06807bb-380c-4a17-adca-245e02ee8c62 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:38.919483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06807bb-380c-4a17-adca-245e02ee8c62 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:38.919761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06807bb-380c-4a17-adca-245e02ee8c62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:38.927819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06807bb-380c-4a17-adca-245e02ee8c62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:38.929450 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06807bb-380c-4a17-adca-245e02ee8c62 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:38.937887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1151/2364] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:48.779357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=47 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:48.934387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=41 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:57.987650 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ea2e1-2ae8-4fd9-a1fc-9b0422255b3e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:57.988181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ea2e1-2ae8-4fd9-a1fc-9b0422255b3e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:57.988298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ea2e1-2ae8-4fd9-a1fc-9b0422255b3e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:57.989706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1214/2365] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:31:57.995828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20672c8-ef64-4bcc-9814-6a210270eff2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:57.996305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20672c8-ef64-4bcc-9814-6a210270eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:57.996447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20672c8-ef64-4bcc-9814-6a210270eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.048796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d20672c8-ef64-4bcc-9814-6a210270eff2 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:58.050294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d20672c8-ef64-4bcc-9814-6a210270eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:58.131707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1152/2366] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:31:58.143830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ea2e1-2ae8-4fd9-a1fc-9b0422255b3e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:58.145488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b65ea2e1-2ae8-4fd9-a1fc-9b0422255b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:58.225676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ea2e1-2ae8-4fd9-a1fc-9b0422255b3e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:58.229899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025d8d-d5f1-4315-9f23-aa3c8763c6a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:58.230577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025d8d-d5f1-4315-9f23-aa3c8763c6a4 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.230865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025d8d-d5f1-4315-9f23-aa3c8763c6a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.231146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025d8d-d5f1-4315-9f23-aa3c8763c6a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.241681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025d8d-d5f1-4315-9f23-aa3c8763c6a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:58.243183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025d8d-d5f1-4315-9f23-aa3c8763c6a4 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:58.256448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1215/2367] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:58.496272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc7a2-b427-4f98-8a23-6ff1bbaeae90 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.496566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc7a2-b427-4f98-8a23-6ff1bbaeae90 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.496844 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc7a2-b427-4f98-8a23-6ff1bbaeae90 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.498261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1153/2368] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:31:58.502997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fda12b-db5d-49c8-b71c-72cf9766fb0c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.503297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fda12b-db5d-49c8-b71c-72cf9766fb0c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.503581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fda12b-db5d-49c8-b71c-72cf9766fb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.521131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f2fda12b-db5d-49c8-b71c-72cf9766fb0c None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:58.522366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f2fda12b-db5d-49c8-b71c-72cf9766fb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:58.573705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1216/2369] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:58.585003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cc7a2-b427-4f98-8a23-6ff1bbaeae90 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:58.586790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0c5cc7a2-b427-4f98-8a23-6ff1bbaeae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:58.600462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cc7a2-b427-4f98-8a23-6ff1bbaeae90 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:58.604104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c85880-5ecb-4b79-9fc0-a8d56519a63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:58.605436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c85880-5ecb-4b79-9fc0-a8d56519a63a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.605436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c85880-5ecb-4b79-9fc0-a8d56519a63a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.605436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c85880-5ecb-4b79-9fc0-a8d56519a63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.612671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c85880-5ecb-4b79-9fc0-a8d56519a63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:58.614177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c85880-5ecb-4b79-9fc0-a8d56519a63a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:58.623001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1154/2370] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:31:58.703763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b323b-0aeb-4bd9-aefd-06ca4c8b72dd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.704058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b323b-0aeb-4bd9-aefd-06ca4c8b72dd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.704346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b323b-0aeb-4bd9-aefd-06ca4c8b72dd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.705754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1217/2371] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:31:58.711159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc74d27-334f-4bed-b269-e883d807eb8e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.711448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc74d27-334f-4bed-b269-e883d807eb8e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.711726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc74d27-334f-4bed-b269-e883d807eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.730180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5fc74d27-334f-4bed-b269-e883d807eb8e None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:58.731381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5fc74d27-334f-4bed-b269-e883d807eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:58.740763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1155/2372] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:58.751567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b323b-0aeb-4bd9-aefd-06ca4c8b72dd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:58.763649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b323b-0aeb-4bd9-aefd-06ca4c8b72dd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:58.767200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:58.767848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:58.768160 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:58.768468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:58.778830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:58.780273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:58.790886 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1218/2373] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:32:02.795239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25defc5-3450-435d-88af-bcbec041c349 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:02.795690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25defc5-3450-435d-88af-bcbec041c349 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:02.795780 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25defc5-3450-435d-88af-bcbec041c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:02.813718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e25defc5-3450-435d-88af-bcbec041c349 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:32:02.814935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e25defc5-3450-435d-88af-bcbec041c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:02.821952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1156/2374] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:32:02.833762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:02.845302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87cac-4561-48a9-af80-686c0fef5207 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:02.850474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:02.851138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:02.851423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:02.851701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:02.860382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:02.861976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:02.870581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1219/2375] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:32:12.809239 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=58 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:12.866805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=70 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:28.261316 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:28.261861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:28.261861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:28.279916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:32:28.281204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:28.288592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1157/2376] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jun 20 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:32:28.301874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:28.313199 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ab49e-3a52-4dfe-9c1b-8f8911f230c9 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:28.318364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:28.318998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:28.319282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:28.319560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:28.327605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:28.329186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:28.337204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1220/2377] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:32:38.274814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:38.333881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:15.030899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:15.032308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:15.048319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f610d-fe80-421e-bc1d-e80152039b64 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:15.054481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:15.055114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:15.055399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:15.055677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:15.057420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:15.115038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:15.117097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:15.125886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1158/2378] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:21.725562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:21.727673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:21.739681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0be3-38e8-4994-9cf2-d03b7daab992 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:21.744091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:21.744741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:21.745025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:21.745302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:21.747119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:21.760735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:21.762219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:21.774137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1221/2379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:25.121631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=28 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:25.271864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:25.281829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ba1a-e93b-4dd5-9631-c6fc9a285346 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:25.285455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:25.286120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:25.286407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:25.286686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:25.288481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:25.301794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:25.303282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92defb31-6618-4792-91d5-3de5bf38b423 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:25.314636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1159/2380] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:26.802421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:26.813944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd96bc5-64ca-4bcc-aa1b-ed04ec922aa0 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:26.819440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:26.820077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:26.820359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:26.820636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:26.822416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:26.880215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:26.882023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:26.891590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1222/2381] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:32.548109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e053-4469-4cef-bb13-18866851808c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:32.548632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e053-4469-4cef-bb13-18866851808c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:32.548836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e053-4469-4cef-bb13-18866851808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:32.566965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bf30e053-4469-4cef-bb13-18866851808c None None] MFA Rules not processed for user `23b06a7649c6454393290c5d8c7e4688`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:33:32.568337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf30e053-4469-4cef-bb13-18866851808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:32.640237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1160/2382] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:33:36.887499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=34 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:37.187923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:37.189318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:37.203717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdcd10-b13f-4bda-a090-2f171a992be6 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:37.209178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:37.209809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:37.210133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:37.210412 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:37.212153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:37.271601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:37.273192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:37.282525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1223/2383] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:40.675177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e053-4469-4cef-bb13-18866851808c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:40.685352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e053-4469-4cef-bb13-18866851808c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:40.689227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:40.689861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:40.690177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:40.690461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:40.692240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:40.703554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:40.707664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:40.716699 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1161/2384] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:43.667509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:43.686960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68161-ad2d-4314-b24f-fdfa50204bc0 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:43.694745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:43.695768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:43.696178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:43.696558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:43.698516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:43.720397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:43.722257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ddb7f-8efe-4aab-84f1-cda37af65f2b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:43.748025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1224/2385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:44.528373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:44.554987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125e93e-6bce-4055-a9fd-753b18e5dac6 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:44.562686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:44.563664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:44.563862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:44.564144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:44.566159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:44.583491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:44.585871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:44.598253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1162/2386] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:48.926428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:48.926428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:48.926428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:48.941408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] MFA Rules not processed for user `f023004fda46413e878274519d68197c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:33:48.942638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:48.950062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1225/2387] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:33:49.650550 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:49.660233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ab14d-31bd-4761-ad6c-456f589412c6 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:49.664052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:49.664691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:49.664975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:49.665251 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:49.667056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:49.676809 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:49.678285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9fea5-c708-434d-a993-0d720c6dd3df service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:49.687281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1163/2388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:50.180492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:50.182035 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:50.254444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e637ac-c779-4090-a38f-f44796cf15b2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:50.259762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:50.260409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:50.260728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:50.261011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:50.262892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:50.274862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:50.276524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:50.299125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1226/2389] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:33:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:50.299252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feef34-d2f3-4b9a-8a2b-dfd1fadd26a5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:50.299252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feef34-d2f3-4b9a-8a2b-dfd1fadd26a5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:50.299252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feef34-d2f3-4b9a-8a2b-dfd1fadd26a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:50.316228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f3feef34-d2f3-4b9a-8a2b-dfd1fadd26a5 None None] MFA Rules not processed for user `c7b99b14245d49d68589866ceffeadc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:33:50.317438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f3feef34-d2f3-4b9a-8a2b-dfd1fadd26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:50.324442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1164/2390] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:33:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:34:00.283027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=69 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:00.310838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=52 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:02.299720 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:02.313076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac305-8e01-4c09-8b44-538599b6b9ce service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:02.320708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:02.321373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:02.321658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:02.321937 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:02.324007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:02.337048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:02.338722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:02.349465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1227/2391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:12.345168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:40.644490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:40.644994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:40.645096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:40.663041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] MFA Rules not processed for user `9ea06252769148759586242b0b5f562c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:34:40.664236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:40.671719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1165/2392] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:34:45.669956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:45.671408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:45.728735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3c97-9330-422c-813f-8f389bd90f6b service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:45.732298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:45.732972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:45.733261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:45.733549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:45.735515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:45.746576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:45.748068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:45.758301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1228/2393] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:50.657860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:55.754241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=26 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:11.532171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:11.542433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420398e1-bb93-44ed-b350-53987c87d008 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:11.545980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:11.546643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:11.546927 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:11.547204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:11.548977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:11.615855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:11.617308 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:11.627038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1166/2394] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:15.263007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:15.275610 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06ab3-456f-45a4-b908-9cdabe6531e1 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:15.280726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:15.281452 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:15.281738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:15.282050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:15.283837 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:15.297147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:15.299000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:15.312766 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1229/2395] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:15.410763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:15.412236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:15.424716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c76bc-c946-4491-8002-72d0052ae436 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:15.429321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:15.430278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:15.430563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:15.430845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] PATH_INFO: `/v3/users/23b06a7649c6454393290c5d8c7e4688` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:15.432034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b06a7649c6454393290c5d8c7e4688)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:15.434048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:15.637244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b06a7649c6454393290c5d8c7e4688'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.650537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b06a7649c6454393290c5d8c7e4688'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.724806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b06a7649c6454393290c5d8c7e4688'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.732080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b06a7649c6454393290c5d8c7e4688'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.732853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fbef8f5a-4d5b-4cd7-bf2d-68d5d81743dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b06a7649c6454393290c5d8c7e4688'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.739200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1167/2396] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:15 2022] DELETE /identity/v3/users/23b06a7649c6454393290c5d8c7e4688 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:35:15.971951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:15.982997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57358e2-bd7e-47ba-8665-67e80a717619 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.045233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.046502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.046795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.047076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] PATH_INFO: `/v3/projects/35d87647754644ccbaa0c2f425b8652c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.048270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d87647754644ccbaa0c2f425b8652c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.050271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.169317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d87647754644ccbaa0c2f425b8652c', 'request_id': 'req-c521298a-85b3-4311-8232-cd304a01eadb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.279169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d87647754644ccbaa0c2f425b8652c', 'request_id': 'req-c521298a-85b3-4311-8232-cd304a01eadb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.286111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d87647754644ccbaa0c2f425b8652c', 'request_id': 'req-c521298a-85b3-4311-8232-cd304a01eadb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.297015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] The token cache is being invalidate because project 35d87647754644ccbaa0c2f425b8652c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:16.297308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.297945 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c521298a-85b3-4311-8232-cd304a01eadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.299519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1230/2397] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:15 2022] DELETE /identity/v3/projects/35d87647754644ccbaa0c2f425b8652c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:16.304432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.304724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.305682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.324787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:16.325981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:16.383622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1168/2398] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:35:16.391263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.391551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.391829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.409600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:16.410817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:16.419089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1231/2399] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:16.423030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.432995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff13c63-153f-4381-b626-5c5cf5b97c0d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.437505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.438186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.438465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.438765 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.439482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:16.440060 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.441650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.443119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:16.453386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1169/2400] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:16.462108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.471269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ff524-4f6f-4068-ab69-755981d44301 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.475949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.476595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.477451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.477675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.478400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.482046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.577437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1232/2401] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:35:16.581499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.592051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f46a1e-abdf-46f4-bdd3-207c64806691 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.646086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.646737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.647016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.647289 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.647970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.650412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.736237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1170/2402] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:16.740145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.750520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b7bb6-a859-4b81-855b-99be9fad7bae admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.755238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.755878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.756158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.756430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.757147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.758852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.768654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1233/2403] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:16.772652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.783079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a03ee-00d3-484d-b448-9f75127b4339 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.787647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5702c1-5302-4954-a8ce-8edb49259acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.789977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5702c1-5302-4954-a8ce-8edb49259acb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.789977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5702c1-5302-4954-a8ce-8edb49259acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.789977 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5702c1-5302-4954-a8ce-8edb49259acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.790385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5702c1-5302-4954-a8ce-8edb49259acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.792157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5702c1-5302-4954-a8ce-8edb49259acb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.802352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1171/2404] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:35:16.806458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.816820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611a46-24f1-4c57-a41c-a63de5e1c665 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.821504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.822420 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.822708 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.823014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] PATH_INFO: `/v3/projects/22e46fa99da740cf9634c05fb4277be0/users/d7a699c02e934b74b9a6dd08570631a9/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.837949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e46fa99da740cf9634c05fb4277be0, user_id=d7a699c02e934b74b9a6dd08570631a9, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.840591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.902580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1234/2405] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:16 2022] PUT /identity/v3/projects/22e46fa99da740cf9634c05fb4277be0/users/d7a699c02e934b74b9a6dd08570631a9/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:16.918122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.918436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.918720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.944748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] MFA Rules not processed for user `d7a699c02e934b74b9a6dd08570631a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:16.946509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:17.009315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1172/2406] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:17.013893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.020728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:17.078128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bcdc8-c7d3-4ad9-9dac-644d2c47f07d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.083062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.083714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.084003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.084287 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.084981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.087542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.172551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1235/2407] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:17 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:17.176925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.187860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4ce2-af4d-4758-a3b3-55776b2eb2b8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.244941 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.245614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.245899 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.246212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.246931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.248928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.256923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:17.435848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1173/2408] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:17 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:17.436559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.436559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048337c-91e7-40fc-be10-6cde1b3cacd5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.436559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.436559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.437218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.437218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.437218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.437218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.437218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1236/2409] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:17.437702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.437702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25b3d3-6ba9-4f40-8e0c-793b18698798 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.437702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.437702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.438145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.438145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] PATH_INFO: `/v3/projects/af7329e6327e4c9aadbb9e64f3fa4019/users/f3155c4bb2f84db0a4c17736f3bb8ea2/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.452640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7329e6327e4c9aadbb9e64f3fa4019, user_id=f3155c4bb2f84db0a4c17736f3bb8ea2, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.455593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.597269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1174/2410] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:17 2022] PUT /identity/v3/projects/af7329e6327e4c9aadbb9e64f3fa4019/users/f3155c4bb2f84db0a4c17736f3bb8ea2/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:17.601207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.611878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cf591-c1c3-4436-aee7-6a60851b20cc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.676360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c00104-c803-4565-ae54-401a07f20a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.677029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00104-c803-4565-ae54-401a07f20a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.677313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00104-c803-4565-ae54-401a07f20a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.677590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00104-c803-4565-ae54-401a07f20a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.678357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c00104-c803-4565-ae54-401a07f20a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.680546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c00104-c803-4565-ae54-401a07f20a4e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.690916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1237/2411] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:17.694961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.705392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c0c65-1021-4218-96d8-332293010c23 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.710229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.711105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.711385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.711659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] PATH_INFO: `/v3/projects/af7329e6327e4c9aadbb9e64f3fa4019/users/f3155c4bb2f84db0a4c17736f3bb8ea2/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.713676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7329e6327e4c9aadbb9e64f3fa4019, user_id=f3155c4bb2f84db0a4c17736f3bb8ea2, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.716377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.727846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1175/2412] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:17 2022] PUT /identity/v3/projects/af7329e6327e4c9aadbb9e64f3fa4019/users/f3155c4bb2f84db0a4c17736f3bb8ea2/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:17.738727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.739020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.739329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.765668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] MFA Rules not processed for user `f3155c4bb2f84db0a4c17736f3bb8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:17.767293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:17.830780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:17.834436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1238/2413] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:17.845458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.847151 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:17.904722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1b259-ed03-4743-9dd9-125871fffb11 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.908497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa93d-71c9-4da8-88f2-baa80801502f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.909144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa93d-71c9-4da8-88f2-baa80801502f service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.909427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa93d-71c9-4da8-88f2-baa80801502f service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.909703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa93d-71c9-4da8-88f2-baa80801502f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.919259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffa93d-71c9-4da8-88f2-baa80801502f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.920707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffa93d-71c9-4da8-88f2-baa80801502f service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.930819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1176/2414] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:18.141258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:18.151676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c780a8-d203-44fd-a93d-19629eb59207 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:18.155589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:18.156241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:18.156527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:18.156801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:18.213923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:18.215415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:18.224410 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1239/2415] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:27.925943 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:28.224514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=28 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:52.426988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed6b02-c406-435f-8496-a0ac791249c4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:52.427494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed6b02-c406-435f-8496-a0ac791249c4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:52.427598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed6b02-c406-435f-8496-a0ac791249c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:52.446942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-86ed6b02-c406-435f-8496-a0ac791249c4 None None] MFA Rules not processed for user `f023004fda46413e878274519d68197c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:52.448037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-86ed6b02-c406-435f-8496-a0ac791249c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:52.505753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1177/2416] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:55.999657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:56.082170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e60e4-23d6-4130-a50b-0193c2f15d5a service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:56.087517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:56.088400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:56.088687 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:56.088968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] PATH_INFO: `/v3/users/d7a699c02e934b74b9a6dd08570631a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:56.090379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a699c02e934b74b9a6dd08570631a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:56.092469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:56.369033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a699c02e934b74b9a6dd08570631a9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.375096 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a699c02e934b74b9a6dd08570631a9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.384927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a699c02e934b74b9a6dd08570631a9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.393732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a699c02e934b74b9a6dd08570631a9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.505281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a699c02e934b74b9a6dd08570631a9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.512870 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1240/2417] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:55 2022] DELETE /identity/v3/users/d7a699c02e934b74b9a6dd08570631a9 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:56.517935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:56.518511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:56.518620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:56.537716 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:56.539700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:56.609137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1178/2418] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:56.620445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:56.622125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:56.687810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a853-2d09-4c17-82c4-1d2937a2a9b7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:56.691833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:56.692490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:56.692811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:56.693121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:56.702480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:56.703932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:56.714341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1241/2419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:57.336333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.337895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:57.353501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c513f-702a-4295-a8b3-174410dc324f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.359112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.360002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.360736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.361020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] PATH_INFO: `/v3/projects/22e46fa99da740cf9634c05fb4277be0` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.371969 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e46fa99da740cf9634c05fb4277be0)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.378206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.517159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e46fa99da740cf9634c05fb4277be0', 'request_id': 'req-308bd498-eb41-42a9-b0ce-b231acaddba1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.528032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e46fa99da740cf9634c05fb4277be0', 'request_id': 'req-308bd498-eb41-42a9-b0ce-b231acaddba1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.534645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e46fa99da740cf9634c05fb4277be0', 'request_id': 'req-308bd498-eb41-42a9-b0ce-b231acaddba1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.629645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] The token cache is being invalidate because project 22e46fa99da740cf9634c05fb4277be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:57.629932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.630697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.632589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1179/2420] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:57 2022] DELETE /identity/v3/projects/22e46fa99da740cf9634c05fb4277be0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:57.638754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.652181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4895d0-d6b0-448d-83b4-8e80c72a8902 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.671894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:57.720750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.722589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.723126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.723691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] PATH_INFO: `/v3/users/f3155c4bb2f84db0a4c17736f3bb8ea2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.726489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3155c4bb2f84db0a4c17736f3bb8ea2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.728606 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.936346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3155c4bb2f84db0a4c17736f3bb8ea2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.937090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3155c4bb2f84db0a4c17736f3bb8ea2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.950448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3155c4bb2f84db0a4c17736f3bb8ea2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.957204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3155c4bb2f84db0a4c17736f3bb8ea2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.023218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8758862c-6f3b-4dbe-a26f-9744b284c4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3155c4bb2f84db0a4c17736f3bb8ea2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.029961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1242/2421] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:57 2022] DELETE /identity/v3/users/f3155c4bb2f84db0a4c17736f3bb8ea2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:58.545481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:58.546937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:58.569041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bd498-eb41-42a9-b0ce-b231acaddba1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:58.597981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:58.629312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:58.630185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.630465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.630741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] PATH_INFO: `/v3/projects/af7329e6327e4c9aadbb9e64f3fa4019` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.631910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7329e6327e4c9aadbb9e64f3fa4019)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:58.633909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:58.735632 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7329e6327e4c9aadbb9e64f3fa4019', 'request_id': 'req-2eef3842-6412-420b-98b3-be6f487770f1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.742295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7329e6327e4c9aadbb9e64f3fa4019', 'request_id': 'req-2eef3842-6412-420b-98b3-be6f487770f1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.747746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7329e6327e4c9aadbb9e64f3fa4019', 'request_id': 'req-2eef3842-6412-420b-98b3-be6f487770f1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.852706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] The token cache is being invalidate because project af7329e6327e4c9aadbb9e64f3fa4019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:58.852990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.853638 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2eef3842-6412-420b-98b3-be6f487770f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.855253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1180/2422] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:58 2022] DELETE /identity/v3/projects/af7329e6327e4c9aadbb9e64f3fa4019 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:35:58.860104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.860550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.860658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.878809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:58.880060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:58.943543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1243/2423] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:58.951472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.951867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.952153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.972200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:58.973583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:58.982573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1181/2424] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:58.986811 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:58.996909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dd502-29ef-4f90-81e2-58805741cc33 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.001553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.002649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.002649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.002854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.003523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:59.003847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.005456 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.017655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1244/2425] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:59.022539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.031793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449ca3f-25bc-41f4-b7cf-5910faf84d1e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.036539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.037781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.038166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.038491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.039164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.041070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.142881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1182/2426] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/projects => generated 355 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:35:59.147745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.158166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eb79-ec58-44de-869c-b2abeca3b4a9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.184555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:59.214475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.215147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.215430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.215705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.216381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.218432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.318484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1245/2427] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/users => generated 278 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:59.322559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.332970 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52e49e-bda9-4d63-85a0-aa025d3f8dbd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.338293 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.338946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.339233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.339514 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.340243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.341864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.352812 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1183/2428] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:59.356878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.367491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edbb51-ac8f-4476-9ad2-d065fcc3927d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.372147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c424e-9155-4917-9740-77af07710bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.372809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c424e-9155-4917-9740-77af07710bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.373097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c424e-9155-4917-9740-77af07710bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.373379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c424e-9155-4917-9740-77af07710bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.374144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c424e-9155-4917-9740-77af07710bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.375746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c424e-9155-4917-9740-77af07710bf7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.386182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1246/2429] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:59.390255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.400405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0250d4-e649-44d0-aeb8-f0f90c9093f3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.405157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.406064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.406353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.406633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] PATH_INFO: `/v3/projects/d312a6b797934ba98422b87e614c610e/users/d00851172edf4d69b6124e61f69bf589/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.421728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d312a6b797934ba98422b87e614c610e, user_id=d00851172edf4d69b6124e61f69bf589, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.424449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.489672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1184/2430] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:59 2022] PUT /identity/v3/projects/d312a6b797934ba98422b87e614c610e/users/d00851172edf4d69b6124e61f69bf589/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:35:59.501437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.501737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.502071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.532132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] MFA Rules not processed for user `d00851172edf4d69b6124e61f69bf589`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:59.533408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:59.598663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1247/2431] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:59.603763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.667033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:59.672548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02307-627d-46ae-b983-349afb15d01f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.677109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.678386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.678676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.678959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.679661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.681594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.763355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1185/2432] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:59.769651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.780943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7faa7-4a0c-44e7-9f8e-862ade8e6853 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.846927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.847537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.847833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.848148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.848860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.851438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.923317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1248/2433] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:59.928420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.939326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5696-4a54-475e-b55e-fea2cf9655ee admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.944406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.945052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.945334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.945655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.946427 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.948030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.959022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1186/2434] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:59.963173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.973218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ba0c-4ede-40cf-a452-816b4d767f22 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.978567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.979477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.979765 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.980045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] PATH_INFO: `/v3/projects/6dabcf931aa64a3eb9b764af4a0703a1/users/503746e7e6234199b34f5813d10a6228/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.996223 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dabcf931aa64a3eb9b764af4a0703a1, user_id=503746e7e6234199b34f5813d10a6228, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.999058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.068527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1249/2435] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:59 2022] PUT /identity/v3/projects/6dabcf931aa64a3eb9b764af4a0703a1/users/503746e7e6234199b34f5813d10a6228/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:00.072602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.082595 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffc09d-6b79-473f-b27a-fd0a56895f0a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.149781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040dc11-6400-4dc7-9bd9-9e9a203a480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.150491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040dc11-6400-4dc7-9bd9-9e9a203a480d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.150786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040dc11-6400-4dc7-9bd9-9e9a203a480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.151071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040dc11-6400-4dc7-9bd9-9e9a203a480d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.151796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040dc11-6400-4dc7-9bd9-9e9a203a480d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.153423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040dc11-6400-4dc7-9bd9-9e9a203a480d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.163399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1187/2436] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:00.167774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.173677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:00.179537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c8ac-571e-4065-bd98-292b9c61a8d4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.185130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.186036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.186333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.186614 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] PATH_INFO: `/v3/projects/6dabcf931aa64a3eb9b764af4a0703a1/users/503746e7e6234199b34f5813d10a6228/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.194169 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dabcf931aa64a3eb9b764af4a0703a1, user_id=503746e7e6234199b34f5813d10a6228, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.196890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.207411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1250/2437] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:00 2022] PUT /identity/v3/projects/6dabcf931aa64a3eb9b764af4a0703a1/users/503746e7e6234199b34f5813d10a6228/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:00.217914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.218426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.218709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.244562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] MFA Rules not processed for user `503746e7e6234199b34f5813d10a6228`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:00.245814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:00.311797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1188/2438] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:00.323775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.325622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:00.382078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da5ae-5dca-4ba9-831c-19396a2d3cd8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.385686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b150aa-08d6-42f9-85ac-f60f8995308a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.386352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b150aa-08d6-42f9-85ac-f60f8995308a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.386643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b150aa-08d6-42f9-85ac-f60f8995308a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.386927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b150aa-08d6-42f9-85ac-f60f8995308a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.395921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b150aa-08d6-42f9-85ac-f60f8995308a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.397881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b150aa-08d6-42f9-85ac-f60f8995308a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.407517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1251/2439] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:00.626363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.635990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d69763-f2b2-4996-849b-296d57e1752a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.639700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.640421 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.640700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.640975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.688496 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:00.698380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.699826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.709105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1189/2440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:08.018013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:08.018528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:08.018609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:08.043608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:08.045137 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:08.127717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1252/2441] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:36:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:08.338728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:08.341033 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:08.443665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55037f-01ec-4a8c-b6de-f53feffaf6ef service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:08.450859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:08.451746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:08.452321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:08.452782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:08.464749 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:08.467361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:08.507083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1190/2442] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:36:18.117170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:18.473914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=37 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:22.314975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:22.377511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08bad7-d139-42f2-b49a-a1708e70ab75 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:22.381934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:22.382819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:22.383101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:22.383392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] PATH_INFO: `/v3/users/d00851172edf4d69b6124e61f69bf589` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:22.384546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00851172edf4d69b6124e61f69bf589)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:22.386500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:22.642141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00851172edf4d69b6124e61f69bf589'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:22.643258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00851172edf4d69b6124e61f69bf589'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:22.655638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00851172edf4d69b6124e61f69bf589'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:22.662608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00851172edf4d69b6124e61f69bf589'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:22.791256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f98eb82-fbf7-43a9-a208-08ded52f2b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00851172edf4d69b6124e61f69bf589'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:22.796313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:22.797726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:22.798366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1253/2443] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:22 2022] DELETE /identity/v3/users/d00851172edf4d69b6124e61f69bf589 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:22.804963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:22.804963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:22.804963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:22.821887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:22.823165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:22.888237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c405-d268-412a-a590-a6e75e8ae1c9 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:22.898039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1254/2444] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:22.907469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:22.909240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:22.937964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:22.972815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:22.973467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:22.973786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:22.974099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:22.975915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:22.976575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484322d1-e27c-4184-be30-e43f2b0c9419 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:22.980349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:22.984593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:22.984593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:22.984593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:22.987556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:22.989605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:22.991662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:22.993101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:23.000882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1191/2445] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:36:23.003524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1255/2446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:36:23.485352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:23.487022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:23.501855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9fcd6-2609-4098-9614-ed3774e4e207 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:23.506524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:23.507404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:23.507677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:23.507959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] PATH_INFO: `/v3/projects/d312a6b797934ba98422b87e614c610e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:23.509134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d312a6b797934ba98422b87e614c610e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:23.515897 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:23.657236 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd312a6b797934ba98422b87e614c610e', 'request_id': 'req-486d83eb-f3b8-4903-84b1-00f539706be5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:23.664197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd312a6b797934ba98422b87e614c610e', 'request_id': 'req-486d83eb-f3b8-4903-84b1-00f539706be5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:23.670083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd312a6b797934ba98422b87e614c610e', 'request_id': 'req-486d83eb-f3b8-4903-84b1-00f539706be5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:23.763688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] The token cache is being invalidate because project d312a6b797934ba98422b87e614c610e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:23.763912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:23.764540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:23.766116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1192/2447] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:23 2022] DELETE /identity/v3/projects/d312a6b797934ba98422b87e614c610e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:23.770143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:23.780280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ffc4-6cfb-477e-9ab5-18c8cbd948d8 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:23.836742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:23.837603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:23.837879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:23.838193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] PATH_INFO: `/v3/users/503746e7e6234199b34f5813d10a6228` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:23.839373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=503746e7e6234199b34f5813d10a6228)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:23.841333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:24.012746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503746e7e6234199b34f5813d10a6228'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.013411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503746e7e6234199b34f5813d10a6228'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.027030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503746e7e6234199b34f5813d10a6228'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.034259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503746e7e6234199b34f5813d10a6228'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.187654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6dc26ed2-9ce2-47b6-b2f9-884a3bbe9a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503746e7e6234199b34f5813d10a6228'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.198050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1256/2448] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:23 2022] DELETE /identity/v3/users/503746e7e6234199b34f5813d10a6228 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:24.635090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:24.636684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:24.652432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d83eb-f3b8-4903-84b1-00f539706be5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:24.664594 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:24.710436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:24.711306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:24.711590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:24.711872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] PATH_INFO: `/v3/projects/6dabcf931aa64a3eb9b764af4a0703a1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:24.713067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dabcf931aa64a3eb9b764af4a0703a1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:24.715050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:24.877039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dabcf931aa64a3eb9b764af4a0703a1', 'request_id': 'req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.883147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dabcf931aa64a3eb9b764af4a0703a1', 'request_id': 'req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.888700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dabcf931aa64a3eb9b764af4a0703a1', 'request_id': 'req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.977271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] The token cache is being invalidate because project 6dabcf931aa64a3eb9b764af4a0703a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:24.978788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.978788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-748a9e29-b67c-4ef2-9adc-e0230e14d6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:24.979877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1193/2449] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:24 2022] DELETE /identity/v3/projects/6dabcf931aa64a3eb9b764af4a0703a1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:24.985079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:24.985669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:24.985864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.006269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:25.007521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:25.050509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:25.073257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1257/2450] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:36:25.082648 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.082945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.083219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.104942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:25.104942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:25.115921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1194/2451] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:25.120358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.130534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf052-8b98-472f-bed0-dae2dc8f963a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.135858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.139337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.139337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.139337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.139337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:36:25.139337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.139803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.152707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1258/2452] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:36:25.157358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.167265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15496-57d7-4b27-9c9d-301ce2a4693e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.172015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.172658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.172944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.173226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.173925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.175890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.295568 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1195/2453] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:25 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:25.299757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.309809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03710efa-ea69-4ec1-bf90-3691246d566a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.368009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.368671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.368953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.369226 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.369900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.371848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.456884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1259/2454] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:25 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:25.458149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.472858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d533-48fe-4f83-8136-80aa0019ba4a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.478440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.479104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.479498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.479665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.480400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.482028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.492837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1196/2455] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:25.496878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.506958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc9b3-e474-4bbe-ab58-bb0990dda7db admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.511558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f980ce-72d1-4bb5-9c87-4278c5ae0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.512218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f980ce-72d1-4bb5-9c87-4278c5ae0e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.512504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f980ce-72d1-4bb5-9c87-4278c5ae0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.512782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f980ce-72d1-4bb5-9c87-4278c5ae0e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.513507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f980ce-72d1-4bb5-9c87-4278c5ae0e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.515122 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f980ce-72d1-4bb5-9c87-4278c5ae0e6a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.525887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1260/2456] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:25.529696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.540468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93b3e-8984-46ec-8deb-a290955edce9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.545118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.545986 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.546292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.546569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] PATH_INFO: `/v3/projects/c989bb80b3b14158aba6a89aa71a3195/users/ac5275da6cf2479782b082c95aa80666/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.560994 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c989bb80b3b14158aba6a89aa71a3195, user_id=ac5275da6cf2479782b082c95aa80666, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.563772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.655630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1197/2457] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:25 2022] PUT /identity/v3/projects/c989bb80b3b14158aba6a89aa71a3195/users/ac5275da6cf2479782b082c95aa80666/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:25.665897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.666440 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.666681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.693957 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] MFA Rules not processed for user `ac5275da6cf2479782b082c95aa80666`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:25.695253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:25.759968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1261/2458] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:25.770445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.814612 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:25.832639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9e72-ce93-4cd7-ad24-b755c1a413bd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.837691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:25.838409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:25.838686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:25.838966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:25.839670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:25.841602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:25.949536 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1198/2459] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:25 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:25.953528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:25.964490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb59c-eb19-4fb3-b888-6fa53455ce71 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:25.999656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:26.024229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.024899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.025295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.025575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.026294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.028301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.119934 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1262/2460] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:25 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:26.124014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.134973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0a85-76f8-4c59-9993-698b57a0ba82 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.139629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.140284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.140570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.140850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.141578 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.143260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.153907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1199/2461] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:26.157887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.167740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7875ab4-5335-4265-92c5-118e6415b8b9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.180740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.181668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.181950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.182265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] PATH_INFO: `/v3/projects/e650f350c0424ca3b7240c712b34b098/users/29dc7399b0904f60b128a2efa60eaacf/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.201143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e650f350c0424ca3b7240c712b34b098, user_id=29dc7399b0904f60b128a2efa60eaacf, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.206322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.335885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1263/2462] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:26 2022] PUT /identity/v3/projects/e650f350c0424ca3b7240c712b34b098/users/29dc7399b0904f60b128a2efa60eaacf/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:26.339865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.350475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9c863-4436-4c8c-9742-d5238cd0f10c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.406050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aae61-1c53-4f94-bba9-e9432152e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.406710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aae61-1c53-4f94-bba9-e9432152e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.406995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aae61-1c53-4f94-bba9-e9432152e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.407273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aae61-1c53-4f94-bba9-e9432152e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.407989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aae61-1c53-4f94-bba9-e9432152e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.409656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aae61-1c53-4f94-bba9-e9432152e2d1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.420629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1200/2463] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:26.424902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.436163 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f74dd-33df-4adc-8e37-05ce255aed68 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.440975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.442171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.442459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.442740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] PATH_INFO: `/v3/projects/e650f350c0424ca3b7240c712b34b098/users/29dc7399b0904f60b128a2efa60eaacf/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.444736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e650f350c0424ca3b7240c712b34b098, user_id=29dc7399b0904f60b128a2efa60eaacf, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.447451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.457697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1264/2464] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:26 2022] PUT /identity/v3/projects/e650f350c0424ca3b7240c712b34b098/users/29dc7399b0904f60b128a2efa60eaacf/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:26.468134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c860-21d1-4f2e-a0d9-23a2e5f27c46 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.468428 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c860-21d1-4f2e-a0d9-23a2e5f27c46 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.468710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c860-21d1-4f2e-a0d9-23a2e5f27c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.496850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a812c860-21d1-4f2e-a0d9-23a2e5f27c46 None None] MFA Rules not processed for user `29dc7399b0904f60b128a2efa60eaacf`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:26.498095 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a812c860-21d1-4f2e-a0d9-23a2e5f27c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:26.581434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1201/2465] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:26.593056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.595197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:26.656511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c75dc-edb5-40a6-9a80-0c311e8c64e0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.656511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c75dc-edb5-40a6-9a80-0c311e8c64e0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.656511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c75dc-edb5-40a6-9a80-0c311e8c64e0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.656511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1202/2466] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:36:26.657930 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2ff71-32ec-491b-b757-142750ac96d8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.660922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.661507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.662801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.663080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.663809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.664298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.664747 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.674828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.676516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.693331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:26.694131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1265/2467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:26.694583 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:26.730789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:26.764011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1203/2468] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:36:26.776442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.777884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:26.837774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97630-188a-4e75-a814-e2c78fc8178f service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.841761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644ee82-bffe-4113-95a0-6ed9b18b60d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.842438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644ee82-bffe-4113-95a0-6ed9b18b60d3 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.842729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644ee82-bffe-4113-95a0-6ed9b18b60d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.843013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644ee82-bffe-4113-95a0-6ed9b18b60d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.853948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644ee82-bffe-4113-95a0-6ed9b18b60d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.858923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644ee82-bffe-4113-95a0-6ed9b18b60d3 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.867120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1266/2469] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:26.875920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:26.885866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c34a-7d7f-4ae1-a9ba-801356466776 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:26.889808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e512e96-b8ee-425e-bd31-2c08fa73ed4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:26.890668 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512e96-b8ee-425e-bd31-2c08fa73ed4b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:26.890959 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512e96-b8ee-425e-bd31-2c08fa73ed4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:26.891240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512e96-b8ee-425e-bd31-2c08fa73ed4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:26.950533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e512e96-b8ee-425e-bd31-2c08fa73ed4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:26.951982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e512e96-b8ee-425e-bd31-2c08fa73ed4b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:26.961619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1204/2470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:27.068994 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0b27-4d2d-45d8-91ba-8259769e227a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:27.069522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0b27-4d2d-45d8-91ba-8259769e227a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:27.069627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0b27-4d2d-45d8-91ba-8259769e227a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:27.071042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1267/2471] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:36:27.075671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5ca5-2750-4c04-b1b5-11daf432948c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:27.075966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5ca5-2750-4c04-b1b5-11daf432948c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:27.076244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5ca5-2750-4c04-b1b5-11daf432948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:27.096596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1e5a5ca5-2750-4c04-b1b5-11daf432948c None None] MFA Rules not processed for user `0db4109ed2c6485eb033cb10eee8e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:27.097850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1e5a5ca5-2750-4c04-b1b5-11daf432948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:27.150446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1205/2472] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:27.161922 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0b27-4d2d-45d8-91ba-8259769e227a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:27.163702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b6ad0b27-4d2d-45d8-91ba-8259769e227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:27.176775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0b27-4d2d-45d8-91ba-8259769e227a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:27.180409 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4813476-9744-4da7-a9d2-aa44b4e0f57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:27.181048 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813476-9744-4da7-a9d2-aa44b4e0f57e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:27.181374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813476-9744-4da7-a9d2-aa44b4e0f57e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:27.181667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813476-9744-4da7-a9d2-aa44b4e0f57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:27.188976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4813476-9744-4da7-a9d2-aa44b4e0f57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:27.190449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4813476-9744-4da7-a9d2-aa44b4e0f57e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:27.199312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1268/2473] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:27.280777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644101dc-42de-4814-8a94-828b760e511d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:27.281128 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644101dc-42de-4814-8a94-828b760e511d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:27.281454 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644101dc-42de-4814-8a94-828b760e511d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:27.282948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1206/2474] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jun 20 12:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:36:27.288421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078b34-76f0-40c2-95ac-45da5a6eb190 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:27.288721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078b34-76f0-40c2-95ac-45da5a6eb190 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:27.289007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078b34-76f0-40c2-95ac-45da5a6eb190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:27.307258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-be078b34-76f0-40c2-95ac-45da5a6eb190 None None] MFA Rules not processed for user `99f73e12101d42c9b94d8b19ec555055`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:27.308466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-be078b34-76f0-40c2-95ac-45da5a6eb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:27.319003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1269/2475] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jun 20 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:27.329105 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644101dc-42de-4814-8a94-828b760e511d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:27.340965 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644101dc-42de-4814-8a94-828b760e511d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:27.344644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:27.345275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:27.345564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:27.345846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:27.365651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:27.367199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:27.379641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1207/2476] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:29.849528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:29.850586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:29.850786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:29.869105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:29.870353 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:29.880331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:29.929040 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1270/2477] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:36:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:36:29.941554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:29.943049 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:30.012418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2df08-c956-4892-b453-ce6819847f2b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:30.017409 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd418ce-922f-47d1-b635-312d76eebdfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:30.018078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd418ce-922f-47d1-b635-312d76eebdfe service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:30.018364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd418ce-922f-47d1-b635-312d76eebdfe service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:30.018642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd418ce-922f-47d1-b635-312d76eebdfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:30.024199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:30.027753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd418ce-922f-47d1-b635-312d76eebdfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:30.029345 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd418ce-922f-47d1-b635-312d76eebdfe service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:30.037446 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1208/2478] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:36:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:36:36.003768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:36.075642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0f5de-6cd7-4fb1-8f6c-54a94831d171 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:36.080288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:36.081156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:36.081441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:36.081751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] PATH_INFO: `/v3/users/ac5275da6cf2479782b082c95aa80666` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:36.082996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5275da6cf2479782b082c95aa80666)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:36.084956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:36.412210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5275da6cf2479782b082c95aa80666'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:36.413618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5275da6cf2479782b082c95aa80666'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:36.431861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5275da6cf2479782b082c95aa80666'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:36.439299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5275da6cf2479782b082c95aa80666'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:36.541182 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5275da6cf2479782b082c95aa80666'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:36.548298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1271/2479] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:36 2022] DELETE /identity/v3/users/ac5275da6cf2479782b082c95aa80666 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:36.552650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:36.553200 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:36.553393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:36.571758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:36.572971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:36.648490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1209/2480] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:36.657772 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:36.659339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:36.707642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:36.724102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241a9bf-2ef7-4422-82e3-d12d5885571f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:36.728634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:36.729418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:36.729778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:36.730088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:36.740635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:36.742700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:36.752987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1272/2481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:37.160022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:37.161556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:37.183480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274748d-de9a-476b-b398-5c5683a02e59 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:37.198440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:37.202227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:37.202227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:37.202227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] PATH_INFO: `/v3/projects/c989bb80b3b14158aba6a89aa71a3195` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:37.202227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c989bb80b3b14158aba6a89aa71a3195)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:37.203230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:37.360176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c989bb80b3b14158aba6a89aa71a3195', 'request_id': 'req-62aeb597-fa4d-41dd-bd08-70d11346efaa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.367556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c989bb80b3b14158aba6a89aa71a3195', 'request_id': 'req-62aeb597-fa4d-41dd-bd08-70d11346efaa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.374481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c989bb80b3b14158aba6a89aa71a3195', 'request_id': 'req-62aeb597-fa4d-41dd-bd08-70d11346efaa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.476108 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] The token cache is being invalidate because project c989bb80b3b14158aba6a89aa71a3195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:37.476451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.477053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.478978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1210/2482] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:37 2022] DELETE /identity/v3/projects/c989bb80b3b14158aba6a89aa71a3195 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:37.482808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:37.495255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5abb7-72ff-4351-a329-ee68e00ef056 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:37.579890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:37.581026 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:37.581389 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:37.581741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] PATH_INFO: `/v3/users/29dc7399b0904f60b128a2efa60eaacf` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:37.583039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29dc7399b0904f60b128a2efa60eaacf)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:37.587024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:37.765594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29dc7399b0904f60b128a2efa60eaacf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.766298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29dc7399b0904f60b128a2efa60eaacf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.779282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29dc7399b0904f60b128a2efa60eaacf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.787011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29dc7399b0904f60b128a2efa60eaacf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.915996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15b93264-2841-413f-85b2-3f222866498f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29dc7399b0904f60b128a2efa60eaacf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:37.922780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1273/2483] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:37 2022] DELETE /identity/v3/users/29dc7399b0904f60b128a2efa60eaacf => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:38.370793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:38.372614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:38.399005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aeb597-fa4d-41dd-bd08-70d11346efaa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:38.469317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:38.470141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:38.470430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:38.470711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] PATH_INFO: `/v3/projects/e650f350c0424ca3b7240c712b34b098` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:38.472051 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e650f350c0424ca3b7240c712b34b098)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:38.474145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:38.497297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:38.637564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e650f350c0424ca3b7240c712b34b098', 'request_id': 'req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:38.645257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e650f350c0424ca3b7240c712b34b098', 'request_id': 'req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:38.651744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e650f350c0424ca3b7240c712b34b098', 'request_id': 'req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:38.997867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] The token cache is being invalidate because project e650f350c0424ca3b7240c712b34b098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:38.998143 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:38.998737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-68b20a04-c087-4d63-8cdd-c3e4fc66e6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:39.000307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1211/2484] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:38 2022] DELETE /identity/v3/projects/e650f350c0424ca3b7240c712b34b098 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:39.006319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.007418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.007418 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.026127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:39.027387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:39.102835 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1274/2485] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:39.105278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.105278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.105278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.127828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:39.129183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:39.138474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1212/2486] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:36:39.142881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.148799 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:39.154573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3b89-19fa-47d9-bf82-57856c78b35a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.159233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.159894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.160178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.160481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.161213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:36:39.161518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.163295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.175167 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1275/2487] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:36:39.179486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.189175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68df57-61fe-4499-9c66-6dbd865546ab None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.194826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.195469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.195754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.196032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.196892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.198857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.301275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1213/2488] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:39.302496 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.313470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e91ed-d823-43a3-b4a6-43a238d1292d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.389215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.389933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.390266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.390541 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.391254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.393197 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.473416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1276/2489] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:36:39.477502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.488494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa785-2309-41d4-9f45-c564ade92d67 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.501949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.502783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.503067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.503354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.504107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.506423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.519540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1214/2490] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:39.523451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.534735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0382351-55fa-4083-b889-b034fcb1566e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.539548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8545b9-2d90-49ee-8fab-2150585a4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.540288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8545b9-2d90-49ee-8fab-2150585a4719 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.540768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8545b9-2d90-49ee-8fab-2150585a4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.541136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8545b9-2d90-49ee-8fab-2150585a4719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.541941 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8545b9-2d90-49ee-8fab-2150585a4719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.543627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8545b9-2d90-49ee-8fab-2150585a4719 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.555180 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1277/2491] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:39.559588 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.574080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14408-9533-4a3c-b710-0be0db3831b9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.578871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.579744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.580024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.580297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] PATH_INFO: `/v3/projects/2813d1654cf84fb5a09bddeed56b4901/users/5ec936fe990c4c04b96e9263f5b7b365/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.595963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2813d1654cf84fb5a09bddeed56b4901, user_id=5ec936fe990c4c04b96e9263f5b7b365, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.598703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.676380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1215/2492] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:39 2022] PUT /identity/v3/projects/2813d1654cf84fb5a09bddeed56b4901/users/5ec936fe990c4c04b96e9263f5b7b365/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:39.687494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.687791 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.688098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.718383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] MFA Rules not processed for user `5ec936fe990c4c04b96e9263f5b7b365`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:39.719621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:39.788944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1278/2493] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:39.795647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:39.874599 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49726b7-ff2f-4522-ba6d-0dae198588b7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:39.879697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:39.880445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:39.880739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:39.881012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:39.881735 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:39.883957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:39.998786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1216/2494] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:39.999215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.009978 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6ab09-420f-45af-91a8-2a56461baa65 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.062495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:40.068866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.070757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.070757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.070757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.070757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.072493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.148085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1279/2495] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:39 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:36:40.151903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.162728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d16e-cdbf-49fe-9dac-10ddedb2495b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.168132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.168790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.169073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.169351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.170115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.171741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.182506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1217/2496] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:40.186751 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.197186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07152-e12d-459e-a73d-426dd67f8bd1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.201796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d26f-2e0d-48e8-8f7d-aa8b21253e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.202498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d26f-2e0d-48e8-8f7d-aa8b21253e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.202805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d26f-2e0d-48e8-8f7d-aa8b21253e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.203061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d26f-2e0d-48e8-8f7d-aa8b21253e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.203789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36d26f-2e0d-48e8-8f7d-aa8b21253e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.205377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36d26f-2e0d-48e8-8f7d-aa8b21253e86 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.215836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1280/2497] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:40.221309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.232110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c347a6-0b08-4a49-9536-561ad8ac72f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.236958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.237822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.238137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.238410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] PATH_INFO: `/v3/projects/0399a80ba4f740a0a9c3ea73274c17d1/users/99da73ab88764550b032363dd20bfb0a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.253439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0399a80ba4f740a0a9c3ea73274c17d1, user_id=99da73ab88764550b032363dd20bfb0a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.256228 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.258471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:40.364445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1218/2498] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:40 2022] PUT /identity/v3/projects/0399a80ba4f740a0a9c3ea73274c17d1/users/99da73ab88764550b032363dd20bfb0a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:40.375594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.376148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.376461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.402584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] MFA Rules not processed for user `99da73ab88764550b032363dd20bfb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:40.403777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:40.466762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1281/2499] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:40.471194 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.532815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c7b8-8f70-4ad2-b625-8165a7146f96 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.537622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.538268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.538574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.538851 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.539524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.541430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.649374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1219/2500] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:40 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:40.653459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.664248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c6a2f-cbb2-4cfb-b435-f4968386e165 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.720952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.721623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.721911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.722369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.723077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.725081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.859047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1282/2501] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:40 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:40.862940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.873736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c5266-e5c5-4bdd-ad25-d35a635fcc79 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.878505 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.879263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.879537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.879818 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.880542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.882868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:40.893466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1220/2502] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:40.897652 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:40.907737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db440b-abad-4754-80dd-141a42e013e6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:40.912677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:40.913043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:40.913326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:40.913600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] PATH_INFO: `/v3/projects/d6b61ca946324782a3c56df9383e17fe/users/d564eb91e32445bf934a79369cd7dd4e/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:40.929664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b61ca946324782a3c56df9383e17fe, user_id=d564eb91e32445bf934a79369cd7dd4e, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:40.932392 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:41.004352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1283/2503] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:40 2022] PUT /identity/v3/projects/d6b61ca946324782a3c56df9383e17fe/users/d564eb91e32445bf934a79369cd7dd4e/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:41.009084 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:41.019212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517faf0c-acfa-461c-8690-88e21d24a7c0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:41.077093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16cfc9-d2ad-46de-99e6-fbc1e224b95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:41.077724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16cfc9-d2ad-46de-99e6-fbc1e224b95d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:41.078029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16cfc9-d2ad-46de-99e6-fbc1e224b95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:41.078315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16cfc9-d2ad-46de-99e6-fbc1e224b95d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:41.079037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16cfc9-d2ad-46de-99e6-fbc1e224b95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:41.080641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16cfc9-d2ad-46de-99e6-fbc1e224b95d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:41.090725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1221/2504] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:41.095173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:41.106281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd02c-69ee-4522-bc0f-e652bedc0e7e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:41.112594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:41.113138 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:41.113478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:41.113816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] PATH_INFO: `/v3/projects/d6b61ca946324782a3c56df9383e17fe/users/d564eb91e32445bf934a79369cd7dd4e/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:41.116091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b61ca946324782a3c56df9383e17fe, user_id=d564eb91e32445bf934a79369cd7dd4e, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:41.119663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:41.130325 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1284/2505] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:41 2022] PUT /identity/v3/projects/d6b61ca946324782a3c56df9383e17fe/users/d564eb91e32445bf934a79369cd7dd4e/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:41.141566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:41.141938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:41.142315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:41.169083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] MFA Rules not processed for user `d564eb91e32445bf934a79369cd7dd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:41.170326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:41.218939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:41.236933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1222/2506] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:41.249476 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:41.254793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:41.273242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:41.310309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67dee6-d77b-4432-aa64-07a8772213c8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:41.313978 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:41.314642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:41.314927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:41.315205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:41.324501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:41.325933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:41.335697 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1285/2507] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:41.460112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:41.461582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:41.473656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07100e-9a6e-4fad-924c-d24a47dce273 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:41.477954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac941f-15cd-47c4-98d6-6bcdd2e49bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:41.478654 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac941f-15cd-47c4-98d6-6bcdd2e49bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:41.478939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac941f-15cd-47c4-98d6-6bcdd2e49bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:41.479220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac941f-15cd-47c4-98d6-6bcdd2e49bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:41.534657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac941f-15cd-47c4-98d6-6bcdd2e49bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:41.536142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac941f-15cd-47c4-98d6-6bcdd2e49bc1 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:41.545713 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1223/2508] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:46.339255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:46.410911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeff14-f314-43b4-a12d-2df120c1b1dc service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:46.415700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:46.416553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:46.416836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:46.417117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] PATH_INFO: `/v3/users/5ec936fe990c4c04b96e9263f5b7b365` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:46.418357 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec936fe990c4c04b96e9263f5b7b365)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:46.420291 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:46.661303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec936fe990c4c04b96e9263f5b7b365'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:46.662019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec936fe990c4c04b96e9263f5b7b365'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:46.674718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec936fe990c4c04b96e9263f5b7b365'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:46.682260 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec936fe990c4c04b96e9263f5b7b365'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:46.746801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec936fe990c4c04b96e9263f5b7b365'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:46.753627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1286/2509] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:46 2022] DELETE /identity/v3/users/5ec936fe990c4c04b96e9263f5b7b365 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:46.758178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:46.758671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:46.758792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:46.775792 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:46.776996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:46.838917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1224/2510] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:46.848784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:46.850267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:46.896949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:46.911662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f890889-8b98-440f-8eef-0eab744d5995 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:46.919789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:46.920453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:46.920735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:46.921025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:46.930839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:46.932307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:46.944254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1287/2511] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:47.479437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:47.480956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:47.495055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a3d2d-b265-480f-b2ee-c56577311931 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:47.502096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:47.502751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:47.503036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:47.503368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] PATH_INFO: `/v3/projects/2813d1654cf84fb5a09bddeed56b4901` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:47.504645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2813d1654cf84fb5a09bddeed56b4901)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:47.507572 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:47.604419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2813d1654cf84fb5a09bddeed56b4901', 'request_id': 'req-eb08d11d-8ba6-4866-ab89-0bc42c52180b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.610821 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2813d1654cf84fb5a09bddeed56b4901', 'request_id': 'req-eb08d11d-8ba6-4866-ab89-0bc42c52180b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.616533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2813d1654cf84fb5a09bddeed56b4901', 'request_id': 'req-eb08d11d-8ba6-4866-ab89-0bc42c52180b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.682099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] The token cache is being invalidate because project 2813d1654cf84fb5a09bddeed56b4901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:47.682389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.683048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.684700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1225/2512] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:47 2022] DELETE /identity/v3/projects/2813d1654cf84fb5a09bddeed56b4901 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:47.688623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:47.699408 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c54f4-8075-4e5b-ada1-10afb8c9ee45 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:47.756422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:47.757216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:47.757543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:47.757808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] PATH_INFO: `/v3/users/99da73ab88764550b032363dd20bfb0a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:47.759546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99da73ab88764550b032363dd20bfb0a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:47.761472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:47.971244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99da73ab88764550b032363dd20bfb0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.971904 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99da73ab88764550b032363dd20bfb0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.984405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99da73ab88764550b032363dd20bfb0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:47.991280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99da73ab88764550b032363dd20bfb0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.087313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99da73ab88764550b032363dd20bfb0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.093847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1288/2513] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:47 2022] DELETE /identity/v3/users/99da73ab88764550b032363dd20bfb0a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:48.614964 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:48.616465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:48.629806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d11d-8ba6-4866-ab89-0bc42c52180b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:48.638233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:48.688374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:48.689222 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:48.689503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:48.689778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] PATH_INFO: `/v3/projects/0399a80ba4f740a0a9c3ea73274c17d1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:48.691050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0399a80ba4f740a0a9c3ea73274c17d1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:48.693264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:48.804243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0399a80ba4f740a0a9c3ea73274c17d1', 'request_id': 'req-d69fa764-5765-455a-8926-ca55387d3e6a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.810644 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0399a80ba4f740a0a9c3ea73274c17d1', 'request_id': 'req-d69fa764-5765-455a-8926-ca55387d3e6a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.820625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0399a80ba4f740a0a9c3ea73274c17d1', 'request_id': 'req-d69fa764-5765-455a-8926-ca55387d3e6a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.918270 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] The token cache is being invalidate because project 0399a80ba4f740a0a9c3ea73274c17d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:48.918872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.919696 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:48.922055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1226/2514] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:48 2022] DELETE /identity/v3/projects/0399a80ba4f740a0a9c3ea73274c17d1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:48.925731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:48.927224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:48.943041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2b4ec-b53e-47ce-9661-6ab7cb2ad24a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:49.001608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:49.002526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:49.002815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:49.003127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] PATH_INFO: `/v3/users/d564eb91e32445bf934a79369cd7dd4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:49.004349 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d564eb91e32445bf934a79369cd7dd4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:49.006324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:49.010570 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:49.229685 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd564eb91e32445bf934a79369cd7dd4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.230369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd564eb91e32445bf934a79369cd7dd4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.242424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd564eb91e32445bf934a79369cd7dd4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.250193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd564eb91e32445bf934a79369cd7dd4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.333565 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4d409da5-ae90-4a4e-bcb7-1db515b7a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd564eb91e32445bf934a79369cd7dd4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.340647 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1289/2515] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:48 2022] DELETE /identity/v3/users/d564eb91e32445bf934a79369cd7dd4e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:49.762988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:49.764437 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:49.777048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa764-5765-455a-8926-ca55387d3e6a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:49.838351 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:49.839211 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:49.839494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:49.839772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] PATH_INFO: `/v3/projects/d6b61ca946324782a3c56df9383e17fe` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:49.841037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b61ca946324782a3c56df9383e17fe)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:49.842971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:49.947509 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:49.950997 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b61ca946324782a3c56df9383e17fe', 'request_id': 'req-a9d5e897-99c2-4efd-b275-adfa2355dab8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.957123 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b61ca946324782a3c56df9383e17fe', 'request_id': 'req-a9d5e897-99c2-4efd-b275-adfa2355dab8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:49.963526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b61ca946324782a3c56df9383e17fe', 'request_id': 'req-a9d5e897-99c2-4efd-b275-adfa2355dab8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:50.058852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] The token cache is being invalidate because project d6b61ca946324782a3c56df9383e17fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:50.059073 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:50.059702 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a9d5e897-99c2-4efd-b275-adfa2355dab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:50.061250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1227/2516] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:49 2022] DELETE /identity/v3/projects/d6b61ca946324782a3c56df9383e17fe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:50.067466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.067947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.068051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.085718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:50.089950 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:50.149076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1290/2517] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:50.158046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.158362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.158640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.178848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:50.180070 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:50.188347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1228/2518] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:50.192909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.204082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6bdb-4ca5-4549-97cc-5c60db1d6959 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:50.208807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:50.209478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.209773 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.210093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.210828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:36:50.211147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:50.213475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:50.225988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1291/2519] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:36:50.230508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.240641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf31b12-9bc5-40dc-bef6-a3efd4b8a0cf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:50.245468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:50.246183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.246468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.246746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.247506 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:50.249390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:50.374081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1229/2520] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:50 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:50.378234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.390245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865197f-b473-445b-b931-05c36925f5c9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:50.456405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:50.456997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.457281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.457559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.458300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:50.460248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:50.550910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:50.560725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1292/2521] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:50 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:50.561864 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.574029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db47afe-2ba6-465a-828c-02dec64e424f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:50.579259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:50.579938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.580346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.580791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.581525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:50.583173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:50.594179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1230/2522] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:36:50.600961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.610869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feb4be-daca-434a-83d2-35e60225050b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:50.615828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ce23c-fed4-4be1-9168-83ea59940e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:50.616493 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ce23c-fed4-4be1-9168-83ea59940e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.616776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ce23c-fed4-4be1-9168-83ea59940e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.617054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ce23c-fed4-4be1-9168-83ea59940e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.617781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ce23c-fed4-4be1-9168-83ea59940e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:50.619959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ce23c-fed4-4be1-9168-83ea59940e75 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:50.640669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1293/2523] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:50.642302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.654634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be7cc-c62a-4da8-a048-2951affca02d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:50.660106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:50.661252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.661617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.661896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] PATH_INFO: `/v3/projects/94d41a4b88a7466c8df2167a6ab70a6c/users/07f7f943b0f640f688f383ca9e8d091e/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.679101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d41a4b88a7466c8df2167a6ab70a6c, user_id=07f7f943b0f640f688f383ca9e8d091e, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:50.682467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:50.769863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1231/2524] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:50 2022] PUT /identity/v3/projects/94d41a4b88a7466c8df2167a6ab70a6c/users/07f7f943b0f640f688f383ca9e8d091e/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:50.833696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:50.834020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:50.834311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:50.860305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] MFA Rules not processed for user `07f7f943b0f640f688f383ca9e8d091e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:50.861516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:50.933972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1294/2525] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:50.935132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:50.999098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39eba9-833e-428e-8884-606421c6272c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.003761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.004419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.004707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.004990 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.005708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.007678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.115337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1232/2526] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:50 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:36:51.126516 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.137722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f12940-9fad-4586-a550-6d562e3b8c33 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.193785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acfbbd-9ed5-41d5-ba33-62b1d18ad217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.194474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acfbbd-9ed5-41d5-ba33-62b1d18ad217 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.194759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acfbbd-9ed5-41d5-ba33-62b1d18ad217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.195055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acfbbd-9ed5-41d5-ba33-62b1d18ad217 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.195731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acfbbd-9ed5-41d5-ba33-62b1d18ad217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.197724 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acfbbd-9ed5-41d5-ba33-62b1d18ad217 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.307750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1295/2527] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:51 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:51.311532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.323336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdce66-1b79-4bfc-8942-355d6d1adf37 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.328757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.329674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.330056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.330314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.333149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.333149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.338204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.338499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.338776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.344992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1233/2528] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:51.349162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.357500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:51.358757 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:51.364282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c5f35-3d69-429c-9615-67c55c2c470f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.365056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.365929 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.366264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.366546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] PATH_INFO: `/v3/projects/1d6e68250d6f4d6ab13b4c7ae67a09b5/users/1e1700ddeb79467bb2a021b98dcc0c21/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.383021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6e68250d6f4d6ab13b4c7ae67a09b5, user_id=1e1700ddeb79467bb2a021b98dcc0c21, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.385732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.416373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1296/2529] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jun 20 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:36:51.428680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.430110 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:51.448066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:51.471181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1234/2530] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:51 2022] PUT /identity/v3/projects/1d6e68250d6f4d6ab13b4c7ae67a09b5/users/1e1700ddeb79467bb2a021b98dcc0c21/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:51.471464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.494982 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:51.508003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db830035-a437-4eda-ac0f-4c8acf74262c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.539826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7166892-f9b5-4d1d-8576-8eca527d4e20 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.545263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.545957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.546275 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.546558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.547287 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.548935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.559090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1235/2531] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:36:51.563263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.574309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7a1b1-d3a8-4b81-a6e8-17a638dc8906 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.578404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.578404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.578404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.578404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.579112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05f2fe-a00f-481f-a314-46a419fc5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.580011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05f2fe-a00f-481f-a314-46a419fc5134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.580292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05f2fe-a00f-481f-a314-46a419fc5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.580569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05f2fe-a00f-481f-a314-46a419fc5134 admin admin] PATH_INFO: `/v3/projects/1d6e68250d6f4d6ab13b4c7ae67a09b5/users/1e1700ddeb79467bb2a021b98dcc0c21/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.582642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05f2fe-a00f-481f-a314-46a419fc5134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6e68250d6f4d6ab13b4c7ae67a09b5, user_id=1e1700ddeb79467bb2a021b98dcc0c21, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.585324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05f2fe-a00f-481f-a314-46a419fc5134 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.595911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1236/2532] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:51 2022] PUT /identity/v3/projects/1d6e68250d6f4d6ab13b4c7ae67a09b5/users/1e1700ddeb79467bb2a021b98dcc0c21/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:51.606391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.606684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.607086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.634480 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] MFA Rules not processed for user `1e1700ddeb79467bb2a021b98dcc0c21`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:51.635825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:51.637649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.639397 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.648148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1297/2533] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:36:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 12:36:51.707377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1237/2534] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:36:51.719584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:51.720992 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:51.785494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a0dd0-2dab-4b46-a9c8-bd371273fa2f service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:51.797683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:51.843019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:51.843679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:51.843961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:51.844240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:51.854375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:51.856108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:51.868376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1298/2535] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:52.154328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:52.155850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:52.173319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8d65-d663-4531-a7fc-a8fb8d8d389a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:52.177711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a12cd-8558-4e68-a141-0edeed07d6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:52.178515 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a12cd-8558-4e68-a141-0edeed07d6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:52.178859 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a12cd-8558-4e68-a141-0edeed07d6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:52.181875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a12cd-8558-4e68-a141-0edeed07d6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:52.245533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a12cd-8558-4e68-a141-0edeed07d6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:52.247093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a12cd-8558-4e68-a141-0edeed07d6e9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:52.256460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1238/2536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:58.542377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:58.606906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31d76a-cd27-4758-9aa6-fca3b6d2332e service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:58.611911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:58.612795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:58.613086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:58.613369 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] PATH_INFO: `/v3/users/07f7f943b0f640f688f383ca9e8d091e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:58.614616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f7f943b0f640f688f383ca9e8d091e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:58.618135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:58.792518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f7f943b0f640f688f383ca9e8d091e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:58.793244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f7f943b0f640f688f383ca9e8d091e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:58.805823 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f7f943b0f640f688f383ca9e8d091e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:58.813442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f7f943b0f640f688f383ca9e8d091e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:58.911808 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f7f943b0f640f688f383ca9e8d091e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:58.918405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1299/2537] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:58 2022] DELETE /identity/v3/users/07f7f943b0f640f688f383ca9e8d091e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:58.923044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:58.923527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:58.924109 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:58.942540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:58.943692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:58.963552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:59.003924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1239/2538] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:59.019492 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:59.021463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:59.060498 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:59.082929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53281522-b167-4d96-91e1-b70164aad855 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:59.086550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:59.087228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:59.087512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:59.087789 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:59.096951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:59.098451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:59.108648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1300/2539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:59.800333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:59.801825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:59.813976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e37a9-ec6c-4a37-b8f8-23f140f12bf7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:59.819435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:59.820327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:59.820615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:59.820892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] PATH_INFO: `/v3/projects/94d41a4b88a7466c8df2167a6ab70a6c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:59.822169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d41a4b88a7466c8df2167a6ab70a6c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:59.824160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:59.918370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d41a4b88a7466c8df2167a6ab70a6c', 'request_id': 'req-07d7584f-dc5c-4ccd-8686-31984f291da0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:59.924443 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d41a4b88a7466c8df2167a6ab70a6c', 'request_id': 'req-07d7584f-dc5c-4ccd-8686-31984f291da0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:59.930094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d41a4b88a7466c8df2167a6ab70a6c', 'request_id': 'req-07d7584f-dc5c-4ccd-8686-31984f291da0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:59.978988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] The token cache is being invalidate because project 94d41a4b88a7466c8df2167a6ab70a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:59.979274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:59.979902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:59.981451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1240/2540] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:59 2022] DELETE /identity/v3/projects/94d41a4b88a7466c8df2167a6ab70a6c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:36:59.985497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:59.995491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a8fb-6b4d-4ee6-af3d-556e5bb7f55e service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:00.052914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:00.053800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:00.054113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:00.054390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] PATH_INFO: `/v3/users/1e1700ddeb79467bb2a021b98dcc0c21` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:00.055556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1700ddeb79467bb2a021b98dcc0c21)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:00.057959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:00.222868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1700ddeb79467bb2a021b98dcc0c21'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.223438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1700ddeb79467bb2a021b98dcc0c21'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.235561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1700ddeb79467bb2a021b98dcc0c21'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.242376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1700ddeb79467bb2a021b98dcc0c21'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.294640 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7bf45eb-3b20-46e3-bdd5-684788fead6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1700ddeb79467bb2a021b98dcc0c21'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.300629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1301/2541] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:59 2022] DELETE /identity/v3/users/1e1700ddeb79467bb2a021b98dcc0c21 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:00.712078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:00.715261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:00.734294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7584f-dc5c-4ccd-8686-31984f291da0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:00.804950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:00.805906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:00.806810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:00.807158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] PATH_INFO: `/v3/projects/1d6e68250d6f4d6ab13b4c7ae67a09b5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:00.808431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6e68250d6f4d6ab13b4c7ae67a09b5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:00.810411 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:00.919160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6e68250d6f4d6ab13b4c7ae67a09b5', 'request_id': 'req-72e68a23-e4b2-4d15-ae15-eba8039e8956'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.920320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:00.925544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6e68250d6f4d6ab13b4c7ae67a09b5', 'request_id': 'req-72e68a23-e4b2-4d15-ae15-eba8039e8956'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:00.931798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6e68250d6f4d6ab13b4c7ae67a09b5', 'request_id': 'req-72e68a23-e4b2-4d15-ae15-eba8039e8956'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:01.035456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] The token cache is being invalidate because project 1d6e68250d6f4d6ab13b4c7ae67a09b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:01.035673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:01.036313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e68a23-e4b2-4d15-ae15-eba8039e8956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:01.037890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1241/2542] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:00 2022] DELETE /identity/v3/projects/1d6e68250d6f4d6ab13b4c7ae67a09b5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:01.043623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.044095 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.044215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.062722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:01.063961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:01.113676 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:01.125437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1302/2543] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:01.133226 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.133511 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.133787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.152604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:01.154484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:01.163118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1242/2544] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:01.168190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.178141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2030a8-b541-4786-b361-81b56aa00975 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.182722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.183378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.183663 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.183943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.184666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:01.184974 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.186608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.198793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1303/2545] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:37:01.202693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.212003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd200cf-9240-4fcc-886d-2102b37eb3a5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.217199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.217830 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.218159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.218442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.219129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.221056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.313129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1243/2546] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:01 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:01.318854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.328919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e006b-7b9f-4c2f-a153-64d725a48d81 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.385524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.386513 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.386801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.387076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.387781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.389721 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.467067 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1304/2547] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:01 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:01.471683 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.481259 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eaa5f-4396-4a16-9380-8d6acee7b9c2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.486035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.486619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.486909 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.487184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.487910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.489527 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.500229 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1244/2548] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:01.504293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.515089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e72ad-46db-4d8b-86e6-63b970ba1f95 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.520146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6421-0d26-4dfc-948b-1f39b8f2a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.520862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6421-0d26-4dfc-948b-1f39b8f2a868 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.521152 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6421-0d26-4dfc-948b-1f39b8f2a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.521435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6421-0d26-4dfc-948b-1f39b8f2a868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.522209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a6421-0d26-4dfc-948b-1f39b8f2a868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.523844 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a6421-0d26-4dfc-948b-1f39b8f2a868 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.535214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1305/2549] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:01.539232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.549380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1eb25-626e-42bf-b6e0-9e7ed3ab8fda admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.554252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.555127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.555408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.555686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] PATH_INFO: `/v3/projects/f3fe88dd6df4414cb00c6fc40e82d99b/users/44c12c73d38c44ab8b554aafbd4f9817/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.572871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fe88dd6df4414cb00c6fc40e82d99b, user_id=44c12c73d38c44ab8b554aafbd4f9817, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.573862 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.679978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1245/2550] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:01 2022] PUT /identity/v3/projects/f3fe88dd6df4414cb00c6fc40e82d99b/users/44c12c73d38c44ab8b554aafbd4f9817/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:01.681422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.681726 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.682038 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.711636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] MFA Rules not processed for user `44c12c73d38c44ab8b554aafbd4f9817`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:01.713463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:01.782416 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1306/2551] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:01.793975 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:01.795733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:01.856589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b6a99-54aa-4dd4-9636-dd212f9045f1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:01.860230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:01.860883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:01.861173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:01.861455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:01.871118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:01.872597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:01.882058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1246/2552] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:08.890884 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:08.891531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:08.951446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab363a82-774c-4309-9e2e-73967cf75d5f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:08.955112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:08.955807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:08.956097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:08.956379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:08.958372 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:08.963681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:09.038677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:09.040079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:09.050874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1307/2553] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:11.878315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=59,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:13.141386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:13.143111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:13.162197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd26b4c-b00c-46e9-b149-b0661cb90368 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:13.164613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:13.165484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:13.165814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:13.166118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] PATH_INFO: `/v3/users/9ea06252769148759586242b0b5f562c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:13.167325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea06252769148759586242b0b5f562c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:13.169262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:13.434339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea06252769148759586242b0b5f562c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:13.446690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea06252769148759586242b0b5f562c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:13.527010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea06252769148759586242b0b5f562c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:13.534429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea06252769148759586242b0b5f562c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:13.535098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6c2d7db-77cc-469d-824b-2af70aa08e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea06252769148759586242b0b5f562c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:13.541223 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1247/2554] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:13 2022] DELETE /identity/v3/users/9ea06252769148759586242b0b5f562c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:13.815402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:13.828594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509633f-c37f-418e-bb74-0715af23d1f0 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:13.893340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:13.894238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:13.894523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:13.894802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] PATH_INFO: `/v3/projects/3a2edf167c394063a3e96fe2705ee8c0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:13.896019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2edf167c394063a3e96fe2705ee8c0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:13.898102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.032348 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2edf167c394063a3e96fe2705ee8c0', 'request_id': 'req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:14.139669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2edf167c394063a3e96fe2705ee8c0', 'request_id': 'req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:14.146466 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2edf167c394063a3e96fe2705ee8c0', 'request_id': 'req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:14.156832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] The token cache is being invalidate because project 3a2edf167c394063a3e96fe2705ee8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:14.157126 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:14.157763 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ef89fdb0-19d6-476f-83e0-f31bdca80fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:14.159342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1308/2555] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:13 2022] DELETE /identity/v3/projects/3a2edf167c394063a3e96fe2705ee8c0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:14.164318 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.167967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.167967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.185482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:14.186720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:14.246462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1248/2556] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:14.254488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.254938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.255218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.273648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:14.274927 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:14.283312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1309/2557] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:14.287645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.298014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec022-0638-4ec3-b6a1-7ee2bbe6f403 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.302689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.306534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.306534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.306534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.306534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:14.306534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:14.307022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.318338 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1249/2558] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:37:14.322745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.332288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461cb2-f4ec-4cb4-bfed-cd697b8c8a90 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.336916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.337561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.338407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.338683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.339415 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:14.341311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.415451 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1310/2559] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:14 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:14.420150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.430930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568c94-5129-48aa-a6db-333969868e00 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.493198 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.494398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.494905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.495342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.496649 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:14.498694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.506277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:14.585984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1250/2560] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:14 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:14.590980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.596547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:14.602166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61ba58-67b2-4d45-bd08-6c03beb72aef admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.607673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.608330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.608636 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.608916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.609638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:14.611377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.621598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1311/2561] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:14.625739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.636365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddb66-6da0-4ab0-95d9-23ebb413952f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.641078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ff572-53f5-48a4-8c2d-6fa750c8d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.641728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ff572-53f5-48a4-8c2d-6fa750c8d4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.642044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ff572-53f5-48a4-8c2d-6fa750c8d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.642331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ff572-53f5-48a4-8c2d-6fa750c8d4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.643052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ff572-53f5-48a4-8c2d-6fa750c8d4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:14.644657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ff572-53f5-48a4-8c2d-6fa750c8d4d9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.656184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1251/2562] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:14.660217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.672914 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfb65-92c5-47e8-b916-909c8aedbbae admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.683605 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.684532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.684815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.685090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] PATH_INFO: `/v3/projects/2397ee3816d7415fb741bb2b774c553b/users/eb897429a79742dba9a33816430c2fb7/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.701834 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2397ee3816d7415fb741bb2b774c553b, user_id=eb897429a79742dba9a33816430c2fb7, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:14.704701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:14.774551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1312/2563] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:14 2022] PUT /identity/v3/projects/2397ee3816d7415fb741bb2b774c553b/users/eb897429a79742dba9a33816430c2fb7/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:14.786559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.786850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.787130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:14.812846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] MFA Rules not processed for user `eb897429a79742dba9a33816430c2fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:14.814098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:14.894426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1252/2564] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:14.907831 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:14.909807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:14.985100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db94b76-9815-411a-b463-0e8ffef52e8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:14.990856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c4d6-3a15-4c26-bafa-3dbdd0658c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:14.991505 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c4d6-3a15-4c26-bafa-3dbdd0658c2e service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:14.991793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c4d6-3a15-4c26-bafa-3dbdd0658c2e service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:14.992078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c4d6-3a15-4c26-bafa-3dbdd0658c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:15.000303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c4d6-3a15-4c26-bafa-3dbdd0658c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:15.001906 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c4d6-3a15-4c26-bafa-3dbdd0658c2e service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:15.011522 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1313/2565] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:18.172622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:18.213714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b56cc-10a9-4429-b977-b271215d6793 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:18.218271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:18.219279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:18.219569 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:18.219847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] PATH_INFO: `/v3/users/eb897429a79742dba9a33816430c2fb7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:18.221032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb897429a79742dba9a33816430c2fb7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:18.223142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:18.399389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb897429a79742dba9a33816430c2fb7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:18.413193 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb897429a79742dba9a33816430c2fb7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:18.416879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:18.504690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb897429a79742dba9a33816430c2fb7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:18.517230 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb897429a79742dba9a33816430c2fb7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:18.518597 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb897429a79742dba9a33816430c2fb7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:18.527725 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1253/2566] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:18 2022] DELETE /identity/v3/users/eb897429a79742dba9a33816430c2fb7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:18.534863 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:18.535608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:18.536207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:18.556761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:18.558201 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:18.620815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1314/2567] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:18.631189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:18.632640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:18.693875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad74d04-ad77-4677-82e8-ce4864d31c36 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:18.698106 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706478d8-feb8-4767-83b2-1fe73968b6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:18.698973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706478d8-feb8-4767-83b2-1fe73968b6fd service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:18.701372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706478d8-feb8-4767-83b2-1fe73968b6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:18.701915 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706478d8-feb8-4767-83b2-1fe73968b6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:18.716592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706478d8-feb8-4767-83b2-1fe73968b6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:18.718171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706478d8-feb8-4767-83b2-1fe73968b6fd service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:18.728067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1254/2568] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:19.153965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.155623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:19.169454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71bf0-cc69-48c7-9fe2-3962f9b6d779 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.174195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.175571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.176025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.176312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] PATH_INFO: `/v3/projects/2397ee3816d7415fb741bb2b774c553b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.177507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2397ee3816d7415fb741bb2b774c553b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.179680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.335124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:19.336364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2397ee3816d7415fb741bb2b774c553b', 'request_id': 'req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:19.425979 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2397ee3816d7415fb741bb2b774c553b', 'request_id': 'req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:19.432549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2397ee3816d7415fb741bb2b774c553b', 'request_id': 'req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:19.443820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] The token cache is being invalidate because project 2397ee3816d7415fb741bb2b774c553b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:19.444106 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:19.444740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4413a3d6-0cc9-4dda-805e-7b8471a6b3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:19.446310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1315/2569] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:19 2022] DELETE /identity/v3/projects/2397ee3816d7415fb741bb2b774c553b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:19.451914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.453611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.453611 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.469847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:19.471083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:19.529879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1255/2570] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:19.537509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.537988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.538111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.556071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:19.557257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:19.565958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1316/2571] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:19.570341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.580539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e32b8-234e-4af4-b550-ac9030258e3d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.585178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.585861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.586181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.586464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.587189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:19.587501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.589117 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.600448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1256/2572] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:37:19.604474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.613692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950d39-6639-40fb-a3a2-987393b028fa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.618381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.619007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.619294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.619576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.620270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.622705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.708743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1317/2573] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:19 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:37:19.712770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.723029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242f29-2e8f-4e47-b1c2-43d05c156f0b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.778973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.779629 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.779966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.780186 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.780871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.782815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.883826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1257/2574] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:19 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:19.888589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.899232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2a4d3-9db5-4651-9125-61c1eef29105 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.903918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.904630 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.905046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.905326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.906083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.907675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.920896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1318/2575] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:19.925280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.925432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.927159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:19.936164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d759-5888-44e3-b728-155e0eb82878 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.940075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2beb92-2d07-4675-b7e4-8ac66e65039a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.941084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.941743 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.942060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.942603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.943330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.944932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.945552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.946526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.946814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.949720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] PATH_INFO: `/v3/users/44c12c73d38c44ab8b554aafbd4f9817` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.949720 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c12c73d38c44ab8b554aafbd4f9817)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.950372 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:19.952021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:19.955229 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1319/2576] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:19.959475 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:19.969365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2f11b-70f2-4815-9f4c-2ee5bdeefb90 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:19.974232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193556-13cb-4d20-a19d-8e90ddd777af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:19.978255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193556-13cb-4d20-a19d-8e90ddd777af admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:19.978255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193556-13cb-4d20-a19d-8e90ddd777af admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:19.978255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193556-13cb-4d20-a19d-8e90ddd777af admin admin] PATH_INFO: `/v3/projects/a6eb4b9276054665bb8ea595d611ee84/users/684e7e831b2f4f8aa1f00a1afab1cfb2/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:19.990917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193556-13cb-4d20-a19d-8e90ddd777af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6eb4b9276054665bb8ea595d611ee84, user_id=684e7e831b2f4f8aa1f00a1afab1cfb2, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:19.993580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193556-13cb-4d20-a19d-8e90ddd777af admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:20.088569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1320/2577] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:19 2022] PUT /identity/v3/projects/a6eb4b9276054665bb8ea595d611ee84/users/684e7e831b2f4f8aa1f00a1afab1cfb2/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:20.098854 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460f03-3939-47f5-a517-7b673517842f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:20.099143 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460f03-3939-47f5-a517-7b673517842f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:20.099421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460f03-3939-47f5-a517-7b673517842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:20.127249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3d460f03-3939-47f5-a517-7b673517842f None None] MFA Rules not processed for user `684e7e831b2f4f8aa1f00a1afab1cfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:20.128463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d460f03-3939-47f5-a517-7b673517842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:20.164798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c12c73d38c44ab8b554aafbd4f9817'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:20.178088 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c12c73d38c44ab8b554aafbd4f9817'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:20.195027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1321/2578] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:20.205775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460f03-3939-47f5-a517-7b673517842f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:20.207384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d460f03-3939-47f5-a517-7b673517842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:20.265035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c12c73d38c44ab8b554aafbd4f9817'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:20.269421 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460f03-3939-47f5-a517-7b673517842f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:20.272949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c12c73d38c44ab8b554aafbd4f9817'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:20.273283 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:20.280466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-73851417-cd35-4a63-b26e-a5dc59298303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c12c73d38c44ab8b554aafbd4f9817'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:20.280579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:20.280579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:20.280579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:20.280579 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:20.280928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1258/2579] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:19 2022] DELETE /identity/v3/users/44c12c73d38c44ab8b554aafbd4f9817 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:20.284388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156b615-8032-424b-a787-478f985b3e21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:20.284674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156b615-8032-424b-a787-478f985b3e21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:20.284955 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156b615-8032-424b-a787-478f985b3e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:20.285098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:20.288915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:20.290402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:20.300247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1322/2580] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:37:20.304517 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4156b615-8032-424b-a787-478f985b3e21 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:20.309176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4156b615-8032-424b-a787-478f985b3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:20.366954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1259/2581] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:20.377531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:20.379258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:20.437709 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea76e3-85bd-4cb0-881c-f948b8855783 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:20.486265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:20.486908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:20.487189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:20.487462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:20.496703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:20.498171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:20.507814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1323/2582] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:20.965770 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156b615-8032-424b-a787-478f985b3e21 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:20.966652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4156b615-8032-424b-a787-478f985b3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:20.980701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156b615-8032-424b-a787-478f985b3e21 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:20.986258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:20.987124 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:20.987408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:20.987691 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] PATH_INFO: `/v3/projects/f3fe88dd6df4414cb00c6fc40e82d99b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:20.989097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fe88dd6df4414cb00c6fc40e82d99b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:20.991079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:21.124981 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fe88dd6df4414cb00c6fc40e82d99b', 'request_id': 'req-5b50d232-8c2b-403a-87cb-cbd72acc4b49'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:21.131260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fe88dd6df4414cb00c6fc40e82d99b', 'request_id': 'req-5b50d232-8c2b-403a-87cb-cbd72acc4b49'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:21.138022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fe88dd6df4414cb00c6fc40e82d99b', 'request_id': 'req-5b50d232-8c2b-403a-87cb-cbd72acc4b49'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:21.209590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] The token cache is being invalidate because project f3fe88dd6df4414cb00c6fc40e82d99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:21.209940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:21.211719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b50d232-8c2b-403a-87cb-cbd72acc4b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:21.213315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1260/2583] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:20 2022] DELETE /identity/v3/projects/f3fe88dd6df4414cb00c6fc40e82d99b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:29.955085 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:29.956637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:29.969921 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5170d0-46b3-4074-b6dd-71ef686abff1 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:30.025184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:30.026060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:30.026338 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:30.026643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] PATH_INFO: `/v3/users/684e7e831b2f4f8aa1f00a1afab1cfb2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:30.027810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] RBAC: Authorizing `identity:delete_user(user_id=684e7e831b2f4f8aa1f00a1afab1cfb2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:30.030273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:30.223132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684e7e831b2f4f8aa1f00a1afab1cfb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:30.223793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684e7e831b2f4f8aa1f00a1afab1cfb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:30.230678 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:30.244801 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684e7e831b2f4f8aa1f00a1afab1cfb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:30.254364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684e7e831b2f4f8aa1f00a1afab1cfb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:30.333179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684e7e831b2f4f8aa1f00a1afab1cfb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:30.339468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1324/2584] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:29 2022] DELETE /identity/v3/users/684e7e831b2f4f8aa1f00a1afab1cfb2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:30.344741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:30.345197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:30.345349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:30.351219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:30.363315 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:30.364531 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:30.421457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1261/2585] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:30.431171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:30.432593 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:30.489584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d303f0-3b9f-4f8c-b049-f4537714994e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:30.493213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18876266-201c-48d1-adfb-fc802bd82c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:30.493851 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876266-201c-48d1-adfb-fc802bd82c08 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:30.494164 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876266-201c-48d1-adfb-fc802bd82c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:30.494447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876266-201c-48d1-adfb-fc802bd82c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:30.503345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876266-201c-48d1-adfb-fc802bd82c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:30.504806 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876266-201c-48d1-adfb-fc802bd82c08 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:30.514707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1325/2586] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:30.942647 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:30.944390 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:30.959039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e5e0-1da2-492c-a7d4-d9c43eaae787 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:30.964258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:30.965369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:30.965577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:30.965868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] PATH_INFO: `/v3/projects/a6eb4b9276054665bb8ea595d611ee84` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:30.967140 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6eb4b9276054665bb8ea595d611ee84)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:30.969122 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.054945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6eb4b9276054665bb8ea595d611ee84', 'request_id': 'req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:31.061712 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6eb4b9276054665bb8ea595d611ee84', 'request_id': 'req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:31.067684 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6eb4b9276054665bb8ea595d611ee84', 'request_id': 'req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:31.123253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] The token cache is being invalidate because project a6eb4b9276054665bb8ea595d611ee84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:31.123540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:31.124184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f3d7a13-2f66-4fca-8890-aa8eac71f11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:31.125755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1262/2587] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:30 2022] DELETE /identity/v3/projects/a6eb4b9276054665bb8ea595d611ee84 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:31.130815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.131231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.131385 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.148954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:31.150218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:31.209821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1326/2588] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:31.224622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.224917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.225204 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.249185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:31.251024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:31.262734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1263/2589] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:31.266896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.276887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc415f-0f4a-4555-b256-3f13fe75d2d9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.281577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.282296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.282582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.282864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.283633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:31.286775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.286775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.297818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1327/2590] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:37:31.302130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.312071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96048f-ac22-4ee1-9b9f-9c8d683190d0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.316619 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.317250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.317783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.318102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.318790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.320703 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.398011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1264/2591] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:31 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:31.402077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.412587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5aa3d-d7b5-44d8-8b06-46f846fe1c41 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.469638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.470339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.470626 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.470905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.471583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.473500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.480841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:31.562052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1328/2592] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:31 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:31.566741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.579267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0660f-129b-41d8-a1ba-887dbe7eabeb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.584235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.584989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.585282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.585617 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.586387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.588052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.599119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1265/2593] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:37:31.603261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.613949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77b1af-109f-4102-b650-745b6d0e4380 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.619061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf4ad-1cf6-4df3-8b57-3e8f523b7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.619718 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf4ad-1cf6-4df3-8b57-3e8f523b7842 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.620003 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf4ad-1cf6-4df3-8b57-3e8f523b7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.620284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf4ad-1cf6-4df3-8b57-3e8f523b7842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.621004 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcf4ad-1cf6-4df3-8b57-3e8f523b7842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.622643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcf4ad-1cf6-4df3-8b57-3e8f523b7842 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.633002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1329/2594] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:31.636883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.646796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833d063-a6bc-4c55-a5d2-18199c622b24 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.651482 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.652331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.652618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.652898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] PATH_INFO: `/v3/projects/01819d1c2d7f4d6aaf521c81adf11444/users/d0491d6aac4c430b8e112386a6c4917f/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.667807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01819d1c2d7f4d6aaf521c81adf11444, user_id=d0491d6aac4c430b8e112386a6c4917f, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.671064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:31.769120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1266/2595] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:31 2022] PUT /identity/v3/projects/01819d1c2d7f4d6aaf521c81adf11444/users/d0491d6aac4c430b8e112386a6c4917f/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:31.780020 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.780309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.780583 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.806793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] MFA Rules not processed for user `d0491d6aac4c430b8e112386a6c4917f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:31.807983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:31.871529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1330/2596] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:31.876243 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:31.901495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:31.936265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb47be-e9c0-4f6b-9f04-180eda620d8c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:31.941552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:31.942248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:31.942789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:31.943071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:31.943757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:31.945835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.043717 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1267/2597] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:31 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:32.047809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.058534 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214538f8-294e-4237-9cde-3f29174e77c4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.114671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.115350 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.115633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.115908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.116629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.118619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.208084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1331/2598] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:32 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:32.212292 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.223284 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c818d-6bc9-401c-b95c-eb2786f9ed7b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.228068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.228723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.229010 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.229290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.230071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.231653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.242323 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1268/2599] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:32.246433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.257001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2638-77ac-4216-a950-3087d378ddc6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.261707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.262648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.263556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.263852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] PATH_INFO: `/v3/projects/b167db285a1d4a45bb25e192f5b2dea9/users/217d4c44ca0749469bb3ae45a922730b/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.278519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b167db285a1d4a45bb25e192f5b2dea9, user_id=217d4c44ca0749469bb3ae45a922730b, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.281187 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.350819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1332/2600] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:32 2022] PUT /identity/v3/projects/b167db285a1d4a45bb25e192f5b2dea9/users/217d4c44ca0749469bb3ae45a922730b/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:32.354802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.365164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48e84e-98b4-4d88-bc3a-a8675988f332 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.420111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53233-bd46-4771-9ffa-e087f79e4360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.420743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53233-bd46-4771-9ffa-e087f79e4360 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.421021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53233-bd46-4771-9ffa-e087f79e4360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.421296 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53233-bd46-4771-9ffa-e087f79e4360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.422076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53233-bd46-4771-9ffa-e087f79e4360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.423666 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53233-bd46-4771-9ffa-e087f79e4360 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.433419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1269/2601] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:37:32.438129 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.448841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4897-6c1d-4023-93dc-9a594c0f190b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.454065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.454944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.455222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.455497 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] PATH_INFO: `/v3/projects/b167db285a1d4a45bb25e192f5b2dea9/users/217d4c44ca0749469bb3ae45a922730b/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.457494 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b167db285a1d4a45bb25e192f5b2dea9, user_id=217d4c44ca0749469bb3ae45a922730b, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.460239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.470280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1333/2602] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:32 2022] PUT /identity/v3/projects/b167db285a1d4a45bb25e192f5b2dea9/users/217d4c44ca0749469bb3ae45a922730b/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:32.480498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.480819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.481103 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.508418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] MFA Rules not processed for user `217d4c44ca0749469bb3ae45a922730b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:32.509626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:32.578697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1270/2603] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:32.590277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.592058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:32.619320 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:32.650795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ada7bb-2e33-444a-a463-6341be68fbad admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.654550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cd342-a43c-4775-847f-7fd1566adaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.655194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cd342-a43c-4775-847f-7fd1566adaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.655483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cd342-a43c-4775-847f-7fd1566adaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.655767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cd342-a43c-4775-847f-7fd1566adaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.664932 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cd342-a43c-4775-847f-7fd1566adaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.666530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cd342-a43c-4775-847f-7fd1566adaa5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.676815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1334/2604] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:32.739508 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:32.759042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:32.801032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165e95-fa0e-46d0-bc88-865b39b2861d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:32.805666 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:32.806559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:32.806847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:32.807139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] PATH_INFO: `/v3/users/d0491d6aac4c430b8e112386a6c4917f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:32.808596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0491d6aac4c430b8e112386a6c4917f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:32.813410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:32.935651 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0491d6aac4c430b8e112386a6c4917f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:32.948089 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0491d6aac4c430b8e112386a6c4917f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.008333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0491d6aac4c430b8e112386a6c4917f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.015470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0491d6aac4c430b8e112386a6c4917f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.016099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0491d6aac4c430b8e112386a6c4917f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.022290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1271/2605] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:32 2022] DELETE /identity/v3/users/d0491d6aac4c430b8e112386a6c4917f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:33.026878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:33.027202 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:33.027489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:33.045403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:33.046642 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:33.105702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1335/2606] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:33.115980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:33.117556 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:33.174737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9c350-95f3-4dc4-ade9-a9171689f067 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:33.178444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:33.179113 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:33.179397 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:33.179676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:33.188931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:33.190417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:33.201382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1272/2607] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:33.597838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:33.599365 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:33.611423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecdf3d-cc8c-4de2-9573-cfe8f104258f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:33.616044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:33.616905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:33.617183 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:33.617458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] PATH_INFO: `/v3/projects/01819d1c2d7f4d6aaf521c81adf11444` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:33.618669 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01819d1c2d7f4d6aaf521c81adf11444)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:33.624911 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:33.750926 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01819d1c2d7f4d6aaf521c81adf11444', 'request_id': 'req-945f7ca9-de39-410b-8757-b50a8c533f0f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.818975 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01819d1c2d7f4d6aaf521c81adf11444', 'request_id': 'req-945f7ca9-de39-410b-8757-b50a8c533f0f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.825587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01819d1c2d7f4d6aaf521c81adf11444', 'request_id': 'req-945f7ca9-de39-410b-8757-b50a8c533f0f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.836490 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] The token cache is being invalidate because project 01819d1c2d7f4d6aaf521c81adf11444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:33.836774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.837404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:33.838972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1336/2608] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:33 2022] DELETE /identity/v3/projects/01819d1c2d7f4d6aaf521c81adf11444 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:33.842999 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:33.852682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc532b-a91f-44c8-861f-b45f36bdc694 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:33.890947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:33.908881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:33.909754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:33.910071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:33.910352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] PATH_INFO: `/v3/users/217d4c44ca0749469bb3ae45a922730b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:33.911545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217d4c44ca0749469bb3ae45a922730b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:33.913478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:34.100855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217d4c44ca0749469bb3ae45a922730b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.113763 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217d4c44ca0749469bb3ae45a922730b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.180215 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217d4c44ca0749469bb3ae45a922730b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.188299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217d4c44ca0749469bb3ae45a922730b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.188948 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03200b03-c8ea-4316-966d-0bb080e609b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217d4c44ca0749469bb3ae45a922730b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.195273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1273/2609] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:33 2022] DELETE /identity/v3/users/217d4c44ca0749469bb3ae45a922730b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:34.603814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:34.605290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:34.619185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f7ca9-de39-410b-8757-b50a8c533f0f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:34.664786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:34.677744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:34.678713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:34.678997 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:34.679273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] PATH_INFO: `/v3/projects/b167db285a1d4a45bb25e192f5b2dea9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:34.680485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b167db285a1d4a45bb25e192f5b2dea9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:34.682633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:34.768644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b167db285a1d4a45bb25e192f5b2dea9', 'request_id': 'req-f85bef9f-cacb-4b4e-8023-c769f9835a57'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.854561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b167db285a1d4a45bb25e192f5b2dea9', 'request_id': 'req-f85bef9f-cacb-4b4e-8023-c769f9835a57'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.861368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b167db285a1d4a45bb25e192f5b2dea9', 'request_id': 'req-f85bef9f-cacb-4b4e-8023-c769f9835a57'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.871810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] The token cache is being invalidate because project b167db285a1d4a45bb25e192f5b2dea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:34.872103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.872739 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85bef9f-cacb-4b4e-8023-c769f9835a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:34.874358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1337/2610] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:34 2022] DELETE /identity/v3/projects/b167db285a1d4a45bb25e192f5b2dea9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:34.879470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:34.879928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:34.880041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:34.898419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:34.899641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:34.961814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1274/2611] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:34.971515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:34.971802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:34.972080 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:34.989901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:34.991107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:34.999299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1338/2612] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:35.003408 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.013020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f4227-e3c4-486b-bac0-5d2b09bc9865 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.018173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.018824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.019110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.019389 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.020118 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:35.020430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.022077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.034267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1275/2613] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:37:35.038211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.047485 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548cbe9-d206-49c7-a8ba-c30981fc50a3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.052115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.052760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.053050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.053328 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.054056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.055962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.141213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1339/2614] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:35 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:35.145136 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.155341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395525-b332-40ca-8096-6f14d61237a5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.198858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:35.212096 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.212761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.213040 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.213310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.214014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.215949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.339312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1276/2615] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:35 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:37:35.343208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.353506 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e414b-9026-4815-b4c0-6505bbcd1fb9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.358150 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.358810 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.359098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.359386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.360119 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.361719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.371919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1340/2616] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:35.376342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.386504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96e44c-643e-4d43-8a71-80309a07b2d1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.391905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bccb9-7651-4dd1-bfdc-656d795251ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.392494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bccb9-7651-4dd1-bfdc-656d795251ea admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.392779 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bccb9-7651-4dd1-bfdc-656d795251ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.393058 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bccb9-7651-4dd1-bfdc-656d795251ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.393778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bccb9-7651-4dd1-bfdc-656d795251ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.395423 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bccb9-7651-4dd1-bfdc-656d795251ea admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.405260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1277/2617] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:37:35.409253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.419149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b46e-a866-4fc7-935c-04c55fcbfa36 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.423654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.424517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.424807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.425184 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] PATH_INFO: `/v3/projects/89f17df60cb84871b84503681c7f6911/users/e5470311c18b4de09e488dd7f080d9b8/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.439881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f17df60cb84871b84503681c7f6911, user_id=e5470311c18b4de09e488dd7f080d9b8, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.442853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.510070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1341/2618] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:37:35 2022] PUT /identity/v3/projects/89f17df60cb84871b84503681c7f6911/users/e5470311c18b4de09e488dd7f080d9b8/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:35.520288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.520581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.520858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.547628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] MFA Rules not processed for user `e5470311c18b4de09e488dd7f080d9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:35.548837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:35.611832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1278/2619] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:37:35.626805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:35.628596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:35.684809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601818d-2cf2-4ee7-b063-cd6ad0875269 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:35.689050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:35.689691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:35.689976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:35.690281 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:35.699551 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:35.700987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:35.709959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1342/2620] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:37:45.608431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:45.705916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:54.837432 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:54.838883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:54.895325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b1ce5-0a86-47c2-81ee-510d75b487ce None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:54.898946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:54.899580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:54.899861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:54.900145 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:54.901878 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:54.964119 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:54.965560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:54.975221 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1279/2621] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:58.211062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:58.224277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97a9d1-ace9-4802-be4f-9c69492abb4f service glance] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:58.229793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:58.230893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:58.231342 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:58.231809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] PATH_INFO: `/v3/users/e5470311c18b4de09e488dd7f080d9b8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:58.233042 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5470311c18b4de09e488dd7f080d9b8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:58.235502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:58.516695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5470311c18b4de09e488dd7f080d9b8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:58.517659 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5470311c18b4de09e488dd7f080d9b8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:58.546960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5470311c18b4de09e488dd7f080d9b8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:58.555075 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5470311c18b4de09e488dd7f080d9b8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:58.659924 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:58.661361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:58.699928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edd5f236-c2c1-4d1e-8692-7a764c6defe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5470311c18b4de09e488dd7f080d9b8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:58.707059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1343/2622] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:58 2022] DELETE /identity/v3/users/e5470311c18b4de09e488dd7f080d9b8 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:58.714654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:58.714654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:58.714654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:58.729402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:58.730644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:58.739631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a03bce-facb-43c6-86b9-6bf0daeeea23 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:58.791855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:58.797267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1344/2623] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:58.804529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:58.804529 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:58.811593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:58.812277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:58.812570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:58.812848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:58.815098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:58.822172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b82b3-b09f-4e32-93d6-21884e625f93 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:58.826948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:58.830778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:58.830778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:58.830778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] PATH_INFO: `/v3/users/f023004fda46413e878274519d68197c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:58.830778 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f023004fda46413e878274519d68197c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:58.831795 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:58.832811 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:58.834491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:58.845224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1280/2624] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:37:58.846152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:58.847748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:58.906558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8da58-bd01-4452-af2c-972e2573d339 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:58.910235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:58.916819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:58.916819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:58.916819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:58.920954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:58.922452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:58.932543 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1281/2625] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:37:59.045166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f023004fda46413e878274519d68197c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.045166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f023004fda46413e878274519d68197c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.058006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f023004fda46413e878274519d68197c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.060086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:59.065345 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f023004fda46413e878274519d68197c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.163117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f023004fda46413e878274519d68197c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.172935 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1345/2626] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:37:58 2022] DELETE /identity/v3/users/f023004fda46413e878274519d68197c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:59.364001 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.365442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:59.378841 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b38cd-bd76-4954-af74-8d6734cc8a9a service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:59.436487 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:59.437352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.437639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.437954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] PATH_INFO: `/v3/projects/89f17df60cb84871b84503681c7f6911` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.439170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f17df60cb84871b84503681c7f6911)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:59.441100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:59.444723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.446972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:59.461850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa5cf-23b8-4cf5-8a16-48f2ec374b86 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:59.467142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:59.468905 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.469267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.469554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] PATH_INFO: `/v3/projects/6d229d86d24441f38a3211c0e2c29eb4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.471043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d229d86d24441f38a3211c0e2c29eb4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:59.475382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:59.568789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f17df60cb84871b84503681c7f6911', 'request_id': 'req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.574932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f17df60cb84871b84503681c7f6911', 'request_id': 'req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.581903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f17df60cb84871b84503681c7f6911', 'request_id': 'req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.597971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d229d86d24441f38a3211c0e2c29eb4', 'request_id': 'req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.694653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] The token cache is being invalidate because project 89f17df60cb84871b84503681c7f6911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:59.695212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.695670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2929ce56-fc0d-4776-9d1f-9a5e7cef43c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.697309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1282/2627] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:59 2022] DELETE /identity/v3/projects/89f17df60cb84871b84503681c7f6911 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:37:59.702112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279bd14-f442-4e91-ad41-9ad80ed4a7a8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.702398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279bd14-f442-4e91-ad41-9ad80ed4a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.702674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279bd14-f442-4e91-ad41-9ad80ed4a7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.721187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9279bd14-f442-4e91-ad41-9ad80ed4a7a8 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:59.722436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9279bd14-f442-4e91-ad41-9ad80ed4a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:59.732024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:59.751069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d229d86d24441f38a3211c0e2c29eb4', 'request_id': 'req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.758375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d229d86d24441f38a3211c0e2c29eb4', 'request_id': 'req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.768961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] The token cache is being invalidate because project 6d229d86d24441f38a3211c0e2c29eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:37:59.769251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.769896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a8b22966-76ab-4fac-ae7f-b7c14c31a0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:37:59.772108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1346/2628] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:37:59 2022] DELETE /identity/v3/projects/6d229d86d24441f38a3211c0e2c29eb4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:37:59.776998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b3a8c-3e91-4017-9708-c07d62fa801a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.777216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b3a8c-3e91-4017-9708-c07d62fa801a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.777504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b3a8c-3e91-4017-9708-c07d62fa801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.782342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1283/2629] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:59.789756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.790082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.790365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.796428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ad0b3a8c-3e91-4017-9708-c07d62fa801a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:59.797668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ad0b3a8c-3e91-4017-9708-c07d62fa801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:59.806165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1347/2630] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:59.809371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:59.810593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:59.814253 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.814546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.814828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.824832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1284/2631] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:59.830828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.833760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:37:59.835572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:37:59.841747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4986d-1458-49c9-98a0-caea63149472 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:59.843881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1348/2632] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:37:59.846504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:59.847276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.847585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.847863 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.847988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.848593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:59.848902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:59.850742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:59.857071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55243e7f-863d-4162-9086-0a19183ae158 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:59.861712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:59.862387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.862673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.863008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.863678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1285/2633] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:37:59.863807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:37:59.864025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:59.865655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:59.867736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.878833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1349/2634] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:37:59.879220 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00dfb5-bd9f-4a95-af86-22defb3fbcc1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:59.882618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.884656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:59.885353 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.885640 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.885918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.886635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:59.888682 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:59.892359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ffb47-9063-4981-b003-18cba9531321 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:37:59.897563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:37:59.898230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:37:59.898519 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:37:59.898796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:37:59.899472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:37:59.901360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:37:59.983917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1350/2635] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:37:59.984114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1286/2636] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:37:59.984969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:37:59.985430 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.049404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25058d9-fb41-4921-9bb8-67acb98e5788 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.052504 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bceb1-a217-4386-a4a5-2b5a68b04b54 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.054638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.055303 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.055588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.055866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.056553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.057937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.058517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.058641 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.058903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.059180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.059861 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.061791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.133809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1351/2637] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:00.137688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.146081 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1287/2638] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:37:59 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:00.147942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3581f60-1c23-464c-bea5-90f7b2ac683b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.149921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.152675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.153335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.153621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.153902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.154781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.156381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.158625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:00.159667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2fb14-e298-4d1e-b285-6bc56be453d8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.164281 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.164913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.165192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.165464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.166246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.166988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1352/2639] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:00.167826 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.171176 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.179838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1288/2640] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:00.182047 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955416-e3a8-4d24-a5ff-06c47adb0070 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.184600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.188151 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.188895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.189193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.189479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.190282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.191895 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.195321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7fc6c-0cf4-49b8-acd6-758df4ce4b23 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.199893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.200562 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.200871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.201141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.201848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.203465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.203871 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1353/2641] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:00.207899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.214499 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1289/2642] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:00.217630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.218128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae34e2f-853d-494d-b87f-2b6096b54070 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.222923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9c968-6208-4e45-85b8-1cce9423a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.223796 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9c968-6208-4e45-85b8-1cce9423a536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.224086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9c968-6208-4e45-85b8-1cce9423a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.224368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9c968-6208-4e45-85b8-1cce9423a536 admin admin] PATH_INFO: `/v3/projects/11564d2b4b574a9291a71ab93da56237/users/5a8ead78371542d9a0e5643a74f6fddd/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.227590 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb7f65-a225-4fb0-8efe-80537fe87976 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.232362 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff356283-92c9-445a-b3cb-3cd3565d1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.233250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff356283-92c9-445a-b3cb-3cd3565d1571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.233534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff356283-92c9-445a-b3cb-3cd3565d1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.233813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff356283-92c9-445a-b3cb-3cd3565d1571 admin admin] PATH_INFO: `/v3/projects/1725f10225cb429c8f3509ef5c2807b8/users/ac9b117f1f244333ae9d209bfda8df0f/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.241549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9c968-6208-4e45-85b8-1cce9423a536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11564d2b4b574a9291a71ab93da56237, user_id=5a8ead78371542d9a0e5643a74f6fddd, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.244250 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9c968-6208-4e45-85b8-1cce9423a536 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.249787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff356283-92c9-445a-b3cb-3cd3565d1571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1725f10225cb429c8f3509ef5c2807b8, user_id=ac9b117f1f244333ae9d209bfda8df0f, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.252544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff356283-92c9-445a-b3cb-3cd3565d1571 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.351543 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1354/2643] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:00 2022] PUT /identity/v3/projects/11564d2b4b574a9291a71ab93da56237/users/5a8ead78371542d9a0e5643a74f6fddd/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:00.362706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.362954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1290/2644] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:00 2022] PUT /identity/v3/projects/1725f10225cb429c8f3509ef5c2807b8/users/ac9b117f1f244333ae9d209bfda8df0f/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:38:00.363099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.364586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.373555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.373784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.375003 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.394239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] MFA Rules not processed for user `5a8ead78371542d9a0e5643a74f6fddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:00.395463 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:00.402781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] MFA Rules not processed for user `ac9b117f1f244333ae9d209bfda8df0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:00.403967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:00.408958 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:00.460510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1355/2645] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:00.469026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1291/2646] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:00.483589 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.484991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:00.497701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.499155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:00.556579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dcc63-d8be-4647-8117-27fda270f13a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.560394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.561056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.561343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.561626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.565028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678d75-d456-4e22-a056-cf795e3fad1e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.570461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.571273 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5cc0-d1f1-4cd9-ac6b-6da37ed21d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.571923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5cc0-d1f1-4cd9-ac6b-6da37ed21d58 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.572039 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.572210 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5cc0-d1f1-4cd9-ac6b-6da37ed21d58 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.572517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5cc0-d1f1-4cd9-ac6b-6da37ed21d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.580531 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f5cc0-d1f1-4cd9-ac6b-6da37ed21d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.580865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1292/2647] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:38:00.582157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f5cc0-d1f1-4cd9-ac6b-6da37ed21d58 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.593662 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1356/2648] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:00.595728 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:00.658152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226adeb-ae29-4238-ab68-62270ee3c2d8 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:00.663433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:00.664298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.664584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.664865 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] PATH_INFO: `/v3/users/5a8ead78371542d9a0e5643a74f6fddd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.666099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8ead78371542d9a0e5643a74f6fddd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:00.668038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:00.827431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8ead78371542d9a0e5643a74f6fddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:00.831953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:00.840247 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8ead78371542d9a0e5643a74f6fddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:00.956602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8ead78371542d9a0e5643a74f6fddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:00.964614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8ead78371542d9a0e5643a74f6fddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:00.965339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8ead78371542d9a0e5643a74f6fddd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:00.972035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1293/2649] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:00 2022] DELETE /identity/v3/users/5a8ead78371542d9a0e5643a74f6fddd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:00.977186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:00.977477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:00.977761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:00.995478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:00.996691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:01.028968 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:01.057207 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1357/2650] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:01.069086 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:01.071012 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:01.136381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93896f45-bc11-4165-9f94-1658ed39fbe0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:01.140581 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5f5b5-7c55-402b-8d29-9f386dcebc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:01.141262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f5b5-7c55-402b-8d29-9f386dcebc22 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:01.141545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f5b5-7c55-402b-8d29-9f386dcebc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:01.141822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f5b5-7c55-402b-8d29-9f386dcebc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:01.154455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f5b5-7c55-402b-8d29-9f386dcebc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:01.156769 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f5b5-7c55-402b-8d29-9f386dcebc22 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:01.182639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1294/2651] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:01.633190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:01.634723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:01.648368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582961-1bac-4200-bf90-f0229a7fee3a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:01.653171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:01.654526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:01.654817 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:01.655294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] PATH_INFO: `/v3/projects/11564d2b4b574a9291a71ab93da56237` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:01.656526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11564d2b4b574a9291a71ab93da56237)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:01.658552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:01.768510 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11564d2b4b574a9291a71ab93da56237', 'request_id': 'req-b6c7b489-857f-4292-9721-f18331f7133e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:01.850056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11564d2b4b574a9291a71ab93da56237', 'request_id': 'req-b6c7b489-857f-4292-9721-f18331f7133e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:01.861798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11564d2b4b574a9291a71ab93da56237', 'request_id': 'req-b6c7b489-857f-4292-9721-f18331f7133e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:01.877358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] The token cache is being invalidate because project 11564d2b4b574a9291a71ab93da56237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:01.877815 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:01.878755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b6c7b489-857f-4292-9721-f18331f7133e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:01.881688 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1358/2652] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:01 2022] DELETE /identity/v3/projects/11564d2b4b574a9291a71ab93da56237 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:01.888996 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:01.889507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:01.889604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:01.907283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:01.908538 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:01.968156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1295/2653] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:01.976482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:01.976780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:01.977071 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:01.996725 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:01.997942 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:02.005976 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1359/2654] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:02.010120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.019857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666c49-557c-46c8-9609-e90611c9db8b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.024442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.025085 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.025367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.025642 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.026435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:02.026743 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.028349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.040484 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1296/2655] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:38:02.049230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.059144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772dda-3eb1-4657-8b96-00503534dae0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.063877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.064592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.064874 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.065147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.065825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.067762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.188555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1360/2656] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:02 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:02.192664 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.205609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117533f-1973-496a-9aa7-2954d45a77f8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.273184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.273764 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.274082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.274358 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.275035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.277011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.283715 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:02.393892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1297/2657] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:02 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:02.395002 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.405959 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130882d-742b-44d0-8080-770d33ba194b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.410632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.411300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.411580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.411860 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.413269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.414881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.428401 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1361/2658] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:02.429731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.439819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5245b8-4628-4cfd-8aaf-21938b8792f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.445237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7417fc9-5150-4398-9e62-ba7d1a42b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.445920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417fc9-5150-4398-9e62-ba7d1a42b417 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.446253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417fc9-5150-4398-9e62-ba7d1a42b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.446660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417fc9-5150-4398-9e62-ba7d1a42b417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.447455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7417fc9-5150-4398-9e62-ba7d1a42b417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.449075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7417fc9-5150-4398-9e62-ba7d1a42b417 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.460492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1298/2659] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:02.464633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.475304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2042f-b61c-426e-9847-e08a5b201cf4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.479872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.480745 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.481079 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.481355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] PATH_INFO: `/v3/projects/70d3b8feb05e4739ac7a45c16f06e073/users/a1780d7df0ed40ff9954fd028cbfe50e/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.496132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d3b8feb05e4739ac7a45c16f06e073, user_id=a1780d7df0ed40ff9954fd028cbfe50e, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.498883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.569051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1362/2660] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:02 2022] PUT /identity/v3/projects/70d3b8feb05e4739ac7a45c16f06e073/users/a1780d7df0ed40ff9954fd028cbfe50e/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:02.580360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.580653 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.580936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.608330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] MFA Rules not processed for user `a1780d7df0ed40ff9954fd028cbfe50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:02.609567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:02.672532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1299/2661] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:02.683700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.685480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:02.742355 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89f63-ca25-49ed-a811-2d01cff2a547 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.746076 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a311-ce3e-40bc-b6ef-b64169d09b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.746715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a311-ce3e-40bc-b6ef-b64169d09b4d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.747000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a311-ce3e-40bc-b6ef-b64169d09b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.747279 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a311-ce3e-40bc-b6ef-b64169d09b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.755581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a311-ce3e-40bc-b6ef-b64169d09b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.757528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a311-ce3e-40bc-b6ef-b64169d09b4d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:02.762239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:02.766859 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1363/2662] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:02.791598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:02.853082 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53aba4-2694-400d-8a39-0bf9a3d7ff0e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:02.857761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:02.858652 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:02.858933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:02.859210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] PATH_INFO: `/v3/users/a1780d7df0ed40ff9954fd028cbfe50e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:02.860417 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1780d7df0ed40ff9954fd028cbfe50e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:02.862494 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:03.091580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1780d7df0ed40ff9954fd028cbfe50e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:03.103778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1780d7df0ed40ff9954fd028cbfe50e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:03.107342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:03.174093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1780d7df0ed40ff9954fd028cbfe50e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:03.182548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1780d7df0ed40ff9954fd028cbfe50e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:03.183218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1780d7df0ed40ff9954fd028cbfe50e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:03.189189 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1300/2663] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:02 2022] DELETE /identity/v3/users/a1780d7df0ed40ff9954fd028cbfe50e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:03.194247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:03.195186 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:03.195467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:03.212634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:03.213846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:03.273098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1364/2664] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:03.282635 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:03.284057 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:03.340886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8108174-81f0-4025-9a2e-c76e17f5ddd1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:03.344463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9152fc7-dd61-425a-95ea-13b3e5858a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:03.345094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9152fc7-dd61-425a-95ea-13b3e5858a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:03.345373 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9152fc7-dd61-425a-95ea-13b3e5858a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:03.345646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9152fc7-dd61-425a-95ea-13b3e5858a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:03.354795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9152fc7-dd61-425a-95ea-13b3e5858a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:03.356171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9152fc7-dd61-425a-95ea-13b3e5858a74 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:03.365685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1301/2665] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:38:03.822127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:03.824111 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:03.837882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896c37-cbaf-42f4-93cc-1778f5a59a19 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:03.842698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:03.847181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:03.847181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:03.847181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] PATH_INFO: `/v3/projects/70d3b8feb05e4739ac7a45c16f06e073` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:03.847181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d3b8feb05e4739ac7a45c16f06e073)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:03.848329 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:03.956828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d3b8feb05e4739ac7a45c16f06e073', 'request_id': 'req-e50f836a-1bce-4c17-bf26-b82975d768ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:04.031241 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d3b8feb05e4739ac7a45c16f06e073', 'request_id': 'req-e50f836a-1bce-4c17-bf26-b82975d768ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:04.038872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d3b8feb05e4739ac7a45c16f06e073', 'request_id': 'req-e50f836a-1bce-4c17-bf26-b82975d768ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:04.052714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] The token cache is being invalidate because project 70d3b8feb05e4739ac7a45c16f06e073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:04.052714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:04.052714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e50f836a-1bce-4c17-bf26-b82975d768ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:04.053104 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1365/2666] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:03 2022] DELETE /identity/v3/projects/70d3b8feb05e4739ac7a45c16f06e073 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:04.057615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.057933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.058244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.077309 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:04.078554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:04.147164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1302/2667] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:04.155523 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.155820 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.156107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.176323 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:04.177737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:04.185947 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1366/2668] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:04.190336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.200871 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735a9f8-95ae-41ff-880e-4b5aa28561f1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.205575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.206264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.206546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.206820 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.207570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:04.207951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.209466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.221916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1303/2669] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:38:04.232660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.242084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7712c6-31fc-4a65-879f-6ff7afddc06b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.246698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.247343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.247643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.247944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.248624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.250683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.357954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1367/2670] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:04 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:04.362162 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.372942 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154849d-1d77-4e55-8627-925a0b24afa0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.428675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.429340 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.429625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.429901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.430620 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.432558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.534360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1304/2671] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:04 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:04.538430 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.548804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575c239-3b1e-4729-ac85-25933158b07a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.553482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.554673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.554954 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.555257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.555977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.557569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.567783 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1368/2672] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:04.572718 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.582783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5ca4-9bfd-490b-a15e-9c2da9bf2a12 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.587521 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6450c7-128a-4097-8d5e-8f38acabc98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.590542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6450c7-128a-4097-8d5e-8f38acabc98e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.590542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6450c7-128a-4097-8d5e-8f38acabc98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.590542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6450c7-128a-4097-8d5e-8f38acabc98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.590542 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6450c7-128a-4097-8d5e-8f38acabc98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.591093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6450c7-128a-4097-8d5e-8f38acabc98e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.592335 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:04.602100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1305/2673] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:04.606216 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.616750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37d5f9-a990-4e6e-b5bb-ac9be140a13c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.621503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.622417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.622703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.622982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] PATH_INFO: `/v3/projects/6db23e9dae4646baabaed28a874a2fd7/users/2e8dcd06c87e4907a208bdd8afc3d01c/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.637916 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db23e9dae4646baabaed28a874a2fd7, user_id=2e8dcd06c87e4907a208bdd8afc3d01c, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.640624 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.739768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1369/2674] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:04 2022] PUT /identity/v3/projects/6db23e9dae4646baabaed28a874a2fd7/users/2e8dcd06c87e4907a208bdd8afc3d01c/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:04.745404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.745706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.746255 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.764138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:04.765349 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:04.824313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1306/2675] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:04.834098 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:04.835877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:04.857866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:04.894489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79702b-4e5f-4b10-b9bc-8946ec7a9196 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:04.898233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5393ff3-0bd8-41ef-bbe3-ae75bc8e7820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:04.899124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393ff3-0bd8-41ef-bbe3-ae75bc8e7820 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:04.899462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393ff3-0bd8-41ef-bbe3-ae75bc8e7820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:04.899910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393ff3-0bd8-41ef-bbe3-ae75bc8e7820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:04.909575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5393ff3-0bd8-41ef-bbe3-ae75bc8e7820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:04.911132 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5393ff3-0bd8-41ef-bbe3-ae75bc8e7820 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:04.921317 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1370/2676] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:06.688263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:06.691466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:06.704547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762a4ae-10c0-4300-9214-f652cd8bd209 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:06.709466 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:06.710043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:06.710326 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:06.710600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] PATH_INFO: `/v3/users/ac9b117f1f244333ae9d209bfda8df0f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:06.711810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9b117f1f244333ae9d209bfda8df0f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:06.713734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:06.981426 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9b117f1f244333ae9d209bfda8df0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:06.994146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9b117f1f244333ae9d209bfda8df0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:07.082461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9b117f1f244333ae9d209bfda8df0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:07.095533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9b117f1f244333ae9d209bfda8df0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:07.096371 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9b117f1f244333ae9d209bfda8df0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:07.110248 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1307/2677] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:06 2022] DELETE /identity/v3/users/ac9b117f1f244333ae9d209bfda8df0f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:07.120653 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:07.121327 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:07.122426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:07.151141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:07.152609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:07.225503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1371/2678] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:07.235564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:07.237165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:07.338978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850fbc-759d-4afe-a637-5a2517757bd2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:07.338978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c7bc-d67b-449b-99a7-af3f9f01f941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:07.338978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c7bc-d67b-449b-99a7-af3f9f01f941 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:07.338978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c7bc-d67b-449b-99a7-af3f9f01f941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:07.339854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c7bc-d67b-449b-99a7-af3f9f01f941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:07.339854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686c7bc-d67b-449b-99a7-af3f9f01f941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:07.342546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686c7bc-d67b-449b-99a7-af3f9f01f941 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:07.353300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1308/2679] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:07.971081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:07.972441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:07.989681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ef86-c03f-4942-bb62-dbd66642cd27 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:08.004288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:08.010526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.010526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.010526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] PATH_INFO: `/v3/projects/1725f10225cb429c8f3509ef5c2807b8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.010526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1725f10225cb429c8f3509ef5c2807b8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:08.010526 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:08.167495 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1725f10225cb429c8f3509ef5c2807b8', 'request_id': 'req-bbbcc9a1-6717-42af-992d-751ed61e33d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:08.276276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1725f10225cb429c8f3509ef5c2807b8', 'request_id': 'req-bbbcc9a1-6717-42af-992d-751ed61e33d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:08.285266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1725f10225cb429c8f3509ef5c2807b8', 'request_id': 'req-bbbcc9a1-6717-42af-992d-751ed61e33d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:08.301056 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] The token cache is being invalidate because project 1725f10225cb429c8f3509ef5c2807b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:08.301477 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:08.302154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbbcc9a1-6717-42af-992d-751ed61e33d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:08.307290 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1372/2680] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:07 2022] DELETE /identity/v3/projects/1725f10225cb429c8f3509ef5c2807b8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:08.309009 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.309674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.309674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.330299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:08.331623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:08.339584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:08.431341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1309/2681] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:08.433723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.433723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.433918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.463639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:08.465830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:08.478525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1373/2682] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:08.483263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:08.512157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23b7d-4a5d-40e3-8226-b050e56d201c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:08.517827 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:08.518833 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.519127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.519824 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.520276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:08.520592 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:08.522934 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:08.549746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1310/2683] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:38:08.550880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:08.564339 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87d737-5955-466e-b8cd-ef13c3ca4fb7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:08.584691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:08.584691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.584691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.584691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.585124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:08.587179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:08.684249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1374/2684] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:08 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:08.688795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:08.701011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7605e2d-4162-4713-a1c6-e0d1cded66d6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:08.768447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:08.769155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.769442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.769726 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.770456 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:08.772418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:08.889908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1311/2685] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:08 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:08.894109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:08.908275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303418-cc10-4414-9d43-54e0a83c0882 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:08.925917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:08.926774 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.927101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.927436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.928141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:08.932604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:08.949024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1375/2686] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:08.950497 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:08.975268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c994ca-9c13-49d2-b38f-d548957385f3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:08.988495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b4461-88de-419e-a2b7-8d86aef5db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:08.989178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b4461-88de-419e-a2b7-8d86aef5db61 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:08.989465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b4461-88de-419e-a2b7-8d86aef5db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:08.989744 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b4461-88de-419e-a2b7-8d86aef5db61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:08.990650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b4461-88de-419e-a2b7-8d86aef5db61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:08.992158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b4461-88de-419e-a2b7-8d86aef5db61 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:09.014458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1312/2687] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:09.020113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:09.031511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc2015-4708-4b20-8c66-e071f7b1e52e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:09.037508 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:09.038444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:09.038738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:09.039112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] PATH_INFO: `/v3/projects/a27de900278d4ea080c1b4183c4b20f9/users/ebf5684353d44c13aa4622511bd8cf0a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:09.043648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:09.064254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27de900278d4ea080c1b4183c4b20f9, user_id=ebf5684353d44c13aa4622511bd8cf0a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:09.067908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:09.155933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1376/2688] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:09 2022] PUT /identity/v3/projects/a27de900278d4ea080c1b4183c4b20f9/users/ebf5684353d44c13aa4622511bd8cf0a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:38:09.168555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:09.169937 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:09.170512 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:09.204420 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] MFA Rules not processed for user `ebf5684353d44c13aa4622511bd8cf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:09.205761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:09.317056 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1313/2689] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:09.317635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:09.319172 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:09.414131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62626a9-2e7a-4e01-9ed7-c84238ba38d5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:09.419044 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ef9b-95b1-4412-8c72-6f6cf886e5c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:09.419590 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ef9b-95b1-4412-8c72-6f6cf886e5c3 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:09.419955 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ef9b-95b1-4412-8c72-6f6cf886e5c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:09.420289 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ef9b-95b1-4412-8c72-6f6cf886e5c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:09.431012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438ef9b-95b1-4412-8c72-6f6cf886e5c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:09.432698 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438ef9b-95b1-4412-8c72-6f6cf886e5c3 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:09.443001 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1377/2690] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:38:09.735307 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:09.745368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:09.807415 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2aed-44e5-40b9-8d12-41860b75f2e5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:09.813478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:09.813797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:09.814272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:09.814560 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] PATH_INFO: `/v3/users/ebf5684353d44c13aa4622511bd8cf0a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:09.815840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf5684353d44c13aa4622511bd8cf0a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:09.817834 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:10.021078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf5684353d44c13aa4622511bd8cf0a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:10.036072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf5684353d44c13aa4622511bd8cf0a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:10.108987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf5684353d44c13aa4622511bd8cf0a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:10.128474 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf5684353d44c13aa4622511bd8cf0a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:10.132721 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf5684353d44c13aa4622511bd8cf0a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:10.140661 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1314/2691] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:09 2022] DELETE /identity/v3/users/ebf5684353d44c13aa4622511bd8cf0a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:10.145070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140e0a-5841-4e1b-894a-1ed4ecc98cd6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:10.145388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140e0a-5841-4e1b-894a-1ed4ecc98cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:10.145671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140e0a-5841-4e1b-894a-1ed4ecc98cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:10.165897 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-95140e0a-5841-4e1b-894a-1ed4ecc98cd6 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:10.167805 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-95140e0a-5841-4e1b-894a-1ed4ecc98cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:10.238460 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1378/2692] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:10.251034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:10.253701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:10.348032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35747964-879d-43f2-99ac-37291d874d88 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:10.354819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:10.355846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:10.356467 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:10.356904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:10.369028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:10.370911 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:10.386161 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1315/2693] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:11.001530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.001987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.002521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.034556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] MFA Rules not processed for user `2e8dcd06c87e4907a208bdd8afc3d01c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:11.038560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:11.198264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:11.207130 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1379/2694] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:11.212304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.213828 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:11.227052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2a41a-bc30-46f0-9c9c-8b353588dda4 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.232757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.233412 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.233722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.234027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.234687 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.237973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.331594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.331594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:11.348298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04dd8-ec7d-41de-8c4d-cf730638a7a9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.354742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.357465 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.358131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.363701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] PATH_INFO: `/v3/projects/a27de900278d4ea080c1b4183c4b20f9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.363701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27de900278d4ea080c1b4183c4b20f9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.363701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.380544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1316/2695] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:11.382181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.394613 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:11.456602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608eed29-2a2c-4228-9886-b8b6b9ff76e6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.461787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.462519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.463021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.463319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.464099 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.466114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.481483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27de900278d4ea080c1b4183c4b20f9', 'request_id': 'req-70bd8063-7aa9-4442-942e-e5f94a0b8377'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:11.590713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27de900278d4ea080c1b4183c4b20f9', 'request_id': 'req-70bd8063-7aa9-4442-942e-e5f94a0b8377'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:11.599861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27de900278d4ea080c1b4183c4b20f9', 'request_id': 'req-70bd8063-7aa9-4442-942e-e5f94a0b8377'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:11.600298 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1317/2696] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:11 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:11.601347 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.613418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd717381-39b5-4697-8f1b-d72cc06ffea4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.616703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] The token cache is being invalidate because project a27de900278d4ea080c1b4183c4b20f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:11.617007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:11.618370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70bd8063-7aa9-4442-942e-e5f94a0b8377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:11.622213 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1380/2697] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:11 2022] DELETE /identity/v3/projects/a27de900278d4ea080c1b4183c4b20f9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:38:11.625936 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970cfe-d0fb-4694-9fdf-3945db679177 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.626264 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970cfe-d0fb-4694-9fdf-3945db679177 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.626546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970cfe-d0fb-4694-9fdf-3945db679177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.648597 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-71970cfe-d0fb-4694-9fdf-3945db679177 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:11.649901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71970cfe-d0fb-4694-9fdf-3945db679177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:11.688011 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.688748 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.689206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.689488 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.690260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.692199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.703838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1318/2698] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:11.710445 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.712564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:11.723852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1381/2699] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:11.729021 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f97174-a0df-49dc-9aae-fcfe1cda6a98 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.732511 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.732853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.733083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.735038 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.736097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.736460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.736806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] PATH_INFO: `/v3/projects/6ad5066ad5b94af39a73487d1d6ab854/users/8c6bb9d3674c49e7aaacfc65f52ec95d/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.755459 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad5066ad5b94af39a73487d1d6ab854, user_id=8c6bb9d3674c49e7aaacfc65f52ec95d, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.758538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:11.758677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.759686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:11.770237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1382/2700] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:11.774896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.785867 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a078575-3e94-43ce-b3f7-056d42c803c4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.791592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.792407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.792775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.793058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.793909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:11.794341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.796043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.808558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1383/2701] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:38:11.812666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:11.822400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ba2-6076-4e9f-8c23-b9e695900bd5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:11.827267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:11.827913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:11.828198 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:11.828474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:11.829158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:11.831133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:11.929005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1319/2702] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:11 2022] PUT /identity/v3/projects/6ad5066ad5b94af39a73487d1d6ab854/users/8c6bb9d3674c49e7aaacfc65f52ec95d/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:38:11.933304 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.019384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1384/2703] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:11 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:12.020304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.036287 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848bfe9-bf66-4295-885c-aa9963d1d3dd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.056746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:12.078387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:12.112596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478d04d-9217-4c83-ace8-71722a430c2c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.123101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.123887 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.124660 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.125023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.131407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.133781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.133922 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.135197 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.135492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.135781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.136700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.138987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.162064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1320/2704] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:12.165979 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.180235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3677-c257-4373-9d5c-b428b3f3c0b6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.183457 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.184435 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.185529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.185896 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] PATH_INFO: `/v3/projects/6ad5066ad5b94af39a73487d1d6ab854/users/8c6bb9d3674c49e7aaacfc65f52ec95d/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.188143 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad5066ad5b94af39a73487d1d6ab854, user_id=8c6bb9d3674c49e7aaacfc65f52ec95d, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.191268 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.205671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1321/2705] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:12 2022] PUT /identity/v3/projects/6ad5066ad5b94af39a73487d1d6ab854/users/8c6bb9d3674c49e7aaacfc65f52ec95d/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:38:12.218442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1385/2706] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:12 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:12.224980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.385434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49504-f89c-47cc-826b-7bcfdb892c94 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.391269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.393101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.393101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.393101 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.394267 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.396097 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.413441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.420087 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1322/2707] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:12.425944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae59e-7a43-4188-8464-45b12492033e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.432113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554520f-5b9a-48ea-9a46-42bc2892c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.433267 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554520f-5b9a-48ea-9a46-42bc2892c082 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.433665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554520f-5b9a-48ea-9a46-42bc2892c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.434340 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554520f-5b9a-48ea-9a46-42bc2892c082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.435297 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554520f-5b9a-48ea-9a46-42bc2892c082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.437483 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554520f-5b9a-48ea-9a46-42bc2892c082 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.457875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.464322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1386/2708] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:38:12.471392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915be31-aad0-4212-9779-2aa6bbd2e8be admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.479334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.485055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.485055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.485055 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] PATH_INFO: `/v3/projects/af37c06b274842b08d6c5b1f16406d5e/users/3251bc213aa74494b4fc98ab28da8cdd/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.514853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af37c06b274842b08d6c5b1f16406d5e, user_id=3251bc213aa74494b4fc98ab28da8cdd, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.517928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.630465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1323/2709] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:12 2022] PUT /identity/v3/projects/af37c06b274842b08d6c5b1f16406d5e/users/3251bc213aa74494b4fc98ab28da8cdd/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:38:12.647524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.647839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.648312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.689788 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] MFA Rules not processed for user `3251bc213aa74494b4fc98ab28da8cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:12.691411 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:12.782211 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1387/2710] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:12.789438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:12.791431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:12.875424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227f5d-0d82-4441-980b-40705ab29026 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:12.879310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a9341-d92e-44b2-87e5-5a0a797222d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:12.879904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a9341-d92e-44b2-87e5-5a0a797222d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:12.880208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a9341-d92e-44b2-87e5-5a0a797222d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:12.880471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a9341-d92e-44b2-87e5-5a0a797222d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:12.890920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a9341-d92e-44b2-87e5-5a0a797222d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:12.892385 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a9341-d92e-44b2-87e5-5a0a797222d9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:12.901947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1324/2711] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:12.921053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:13.031923 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eab2f6-ba5c-4ac0-8f38-634e07c8b16f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:13.038373 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:13.039552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:13.040245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:13.040809 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] PATH_INFO: `/v3/users/3251bc213aa74494b4fc98ab28da8cdd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:13.042424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3251bc213aa74494b4fc98ab28da8cdd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:13.045011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:13.384603 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3251bc213aa74494b4fc98ab28da8cdd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:13.385405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3251bc213aa74494b4fc98ab28da8cdd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:13.387781 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:13.427981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3251bc213aa74494b4fc98ab28da8cdd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:13.445885 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3251bc213aa74494b4fc98ab28da8cdd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:13.545395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3251bc213aa74494b4fc98ab28da8cdd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:13.558248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1388/2712] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:12 2022] DELETE /identity/v3/users/3251bc213aa74494b4fc98ab28da8cdd => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:13.560582 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:13.561071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:13.561254 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:13.615733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:13.616925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:13.634064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:13.736388 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1325/2713] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:13.744321 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:13.748616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:13.823479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a41a8-06b7-4058-adc9-1d6583266f26 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:13.827559 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22b48-3ec3-44f0-8bcc-537991c400c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:13.828428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22b48-3ec3-44f0-8bcc-537991c400c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:13.828711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22b48-3ec3-44f0-8bcc-537991c400c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:13.828995 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22b48-3ec3-44f0-8bcc-537991c400c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:13.841568 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b22b48-3ec3-44f0-8bcc-537991c400c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:13.848816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b22b48-3ec3-44f0-8bcc-537991c400c0 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:13.854596 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1389/2714] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:14.457710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:14.459370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:14.472203 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c45317-c73b-4ec6-b8d3-0bce8a26a018 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:14.480406 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:14.482935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:14.483400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:14.492983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] PATH_INFO: `/v3/projects/af37c06b274842b08d6c5b1f16406d5e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:14.492983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af37c06b274842b08d6c5b1f16406d5e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:14.492983 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:14.617960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af37c06b274842b08d6c5b1f16406d5e', 'request_id': 'req-b0ce05bf-7852-4362-b57f-fea8a84b5502'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:14.628381 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af37c06b274842b08d6c5b1f16406d5e', 'request_id': 'req-b0ce05bf-7852-4362-b57f-fea8a84b5502'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:14.637610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af37c06b274842b08d6c5b1f16406d5e', 'request_id': 'req-b0ce05bf-7852-4362-b57f-fea8a84b5502'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:14.714711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] The token cache is being invalidate because project af37c06b274842b08d6c5b1f16406d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:14.715314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:14.716240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b0ce05bf-7852-4362-b57f-fea8a84b5502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:14.722091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1326/2715] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:14 2022] DELETE /identity/v3/projects/af37c06b274842b08d6c5b1f16406d5e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:14.723691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:14.724586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:14.725022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:14.749252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:14.750858 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:14.895730 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1390/2716] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:14.903992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:14.904297 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:14.904589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:14.927205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:14.928468 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:14.946068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1327/2717] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:14.950542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:14.963066 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47caa8-4926-45a4-8c3d-da6ef67aa5a3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:14.976949 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:14.977784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:14.978269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:14.978562 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:14.979375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:14.979619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:14.981257 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.019956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:15.026118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1391/2718] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:38:15.031709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9d778-874c-4ce7-9b12-8524efd5e2d7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:15.036869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:15.037545 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.037819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.038134 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.038853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:15.041732 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.139093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1328/2719] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:15 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:15.143527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:15.170128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76acd47-ffde-4d77-aab3-c4885a58d6a3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:15.308722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:15.321715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:15.322675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.323354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.323354 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.325217 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:15.331346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.510077 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1392/2720] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:15 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:15.511447 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:15.522931 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aef79f-38f9-4754-92b0-965407e510cb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:15.532589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:15.533636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.533935 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.534384 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.538567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:15.538567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.554803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1329/2721] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:15.558901 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:15.575499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451e07-0d50-43ed-b4ff-9605c96db42e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:15.579946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686c06-754b-4c04-b5db-a934b2301459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:15.581450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686c06-754b-4c04-b5db-a934b2301459 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.582112 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686c06-754b-4c04-b5db-a934b2301459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.582638 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686c06-754b-4c04-b5db-a934b2301459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.583539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1686c06-754b-4c04-b5db-a934b2301459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:15.585501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1686c06-754b-4c04-b5db-a934b2301459 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.611607 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:15.623181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1393/2722] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:15.630175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278e78c-33bd-4a2a-a138-8876157fc340 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:15.645477 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:15.646742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.647024 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.647364 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] PATH_INFO: `/v3/projects/ae4fd6d1c4cc414284f346ec31ca5432/users/0b8f1907721c44e1b7df1aeb451bdd3a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.669098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4fd6d1c4cc414284f346ec31ca5432, user_id=0b8f1907721c44e1b7df1aeb451bdd3a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:15.671910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.755693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1330/2723] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:15 2022] PUT /identity/v3/projects/ae4fd6d1c4cc414284f346ec31ca5432/users/0b8f1907721c44e1b7df1aeb451bdd3a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:15.757442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9973-23a9-4749-a67d-3b6171d3edde None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.758553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9973-23a9-4749-a67d-3b6171d3edde None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.758644 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9973-23a9-4749-a67d-3b6171d3edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.776963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-20af9973-23a9-4749-a67d-3b6171d3edde None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:15.778232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-20af9973-23a9-4749-a67d-3b6171d3edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:15.838964 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1394/2724] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:15.848334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:15.850199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:15.888444 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:15.918618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ae7b-930a-488d-a6ac-2a27e4b405b1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:15.923804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:15.924701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:15.925165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:15.925618 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:15.936633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:15.938269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:15.950520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1331/2725] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:17.699689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:17.703807 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:17.704377 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:17.737145 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] MFA Rules not processed for user `0b8f1907721c44e1b7df1aeb451bdd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:17.738651 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:17.809337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1395/2726] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:17.821114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:17.822614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:17.892751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326671-fe42-4e16-ba9d-597b98ebe30e service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:17.896843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74580ede-9e62-49b2-9c7c-8cbd4ac06305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:17.897368 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74580ede-9e62-49b2-9c7c-8cbd4ac06305 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:17.898047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74580ede-9e62-49b2-9c7c-8cbd4ac06305 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:17.899107 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74580ede-9e62-49b2-9c7c-8cbd4ac06305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:17.916295 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74580ede-9e62-49b2-9c7c-8cbd4ac06305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:17.918623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74580ede-9e62-49b2-9c7c-8cbd4ac06305 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:17.942434 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1332/2727] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:18.573848 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:18.575571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:18.597159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6e80-2ea6-402c-9dbf-8d664ed0d6ea None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:18.611362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:18.611362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:18.611362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:18.611362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:18.613330 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:18.628635 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:18.630118 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:18.641561 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1396/2728] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:19.071789 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713648-8f22-44c3-a49a-69590d685745 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:19.072360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713648-8f22-44c3-a49a-69590d685745 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:19.072360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713648-8f22-44c3-a49a-69590d685745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:19.103788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-66713648-8f22-44c3-a49a-69590d685745 None None] MFA Rules not processed for user `8c6bb9d3674c49e7aaacfc65f52ec95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:19.105382 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-66713648-8f22-44c3-a49a-69590d685745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:19.192876 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1333/2729] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:19.206314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:19.208787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:19.293179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62416fbe-14cc-4002-8d10-527cdda46e06 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:19.300156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2124f6539264fa3a4b0ec190e23b2d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:19.302282 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:19.302759 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:19.303554 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:19.308779 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:19.319449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:19.389395 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:19.394426 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb02852-e51c-47e4-9676-d47eede146df service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:19.434363 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1397/2730] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:19.709729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:19.710507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:19.710966 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:19.741018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:19.742807 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:19.803175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1334/2731] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:19.919754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:19.920043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:19.920324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:19.937988 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] MFA Rules not processed for user `0b8f1907721c44e1b7df1aeb451bdd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:19.939336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:19.946770 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1398/2732] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:19.978441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:19.979884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:19.990917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:20.060483 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38934209-57e1-49c7-a81d-705eb25bd7cb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:20.065817 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:20.066704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:20.066998 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:20.067274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:20.090029 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:20.091781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:20.120836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1335/2733] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:38:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:20.215524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:20.237402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0eb5-31a5-4a93-a13c-8834d0d6f4f4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:20.243973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:20.245006 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:20.245443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:20.245878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:20.248050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:20.368046 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:20.369861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:20.402065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1399/2734] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:23.633157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:23.635516 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:23.672686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9650cd-f052-4276-84b9-b6e76e04f01d service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:23.686656 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:23.688731 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:23.689176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:23.694288 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] PATH_INFO: `/v3/users/c7b99b14245d49d68589866ceffeadc3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:23.714265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b99b14245d49d68589866ceffeadc3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:23.717091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:23.878173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b99b14245d49d68589866ceffeadc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:23.924464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b99b14245d49d68589866ceffeadc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:24.013797 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b99b14245d49d68589866ceffeadc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:24.031068 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b99b14245d49d68589866ceffeadc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:24.031873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d88a91f6-70a4-4239-8e29-d167527d92f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b99b14245d49d68589866ceffeadc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:24.040919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1336/2735] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:23 2022] DELETE /identity/v3/users/c7b99b14245d49d68589866ceffeadc3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:24.581166 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:24.599785 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29c720-4c7d-4068-8595-33449c8bc57b service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:24.722982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:24.724165 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:24.724601 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:24.725027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] PATH_INFO: `/v3/projects/d5467180d0b64c5ea5fb331b71e2f00c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:24.741566 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5467180d0b64c5ea5fb331b71e2f00c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:24.745148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:24.773908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:24.904368 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5467180d0b64c5ea5fb331b71e2f00c', 'request_id': 'req-f85584b8-92b8-469f-b8c8-5768e20181bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:24.979616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5467180d0b64c5ea5fb331b71e2f00c', 'request_id': 'req-f85584b8-92b8-469f-b8c8-5768e20181bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:24.988840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5467180d0b64c5ea5fb331b71e2f00c', 'request_id': 'req-f85584b8-92b8-469f-b8c8-5768e20181bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:25.016313 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] The token cache is being invalidate because project d5467180d0b64c5ea5fb331b71e2f00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:25.017024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:25.019010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f85584b8-92b8-469f-b8c8-5768e20181bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:25.021433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1400/2736] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:24 2022] DELETE /identity/v3/projects/d5467180d0b64c5ea5fb331b71e2f00c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:25.033006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.033006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.033006 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.056403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:25.058363 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:25.151616 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:25.173525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1337/2737] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:25.173741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000121c-2067-4886-8592-80e06177d45a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.173908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000121c-2067-4886-8592-80e06177d45a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.174215 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000121c-2067-4886-8592-80e06177d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.205488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e000121c-2067-4886-8592-80e06177d45a None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:25.207403 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e000121c-2067-4886-8592-80e06177d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:25.219550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1401/2738] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:25.223526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.244614 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29e44-c18d-4c1b-8332-f0f491793489 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.253048 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.254170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.254678 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.255110 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.256050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:25.256365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:25.258630 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:25.281761 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1338/2739] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:38:25.283898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000121c-2067-4886-8592-80e06177d45a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.307969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000121c-2067-4886-8592-80e06177d45a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.325487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.326220 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.326577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.326872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.328243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:25.329822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:25.463684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1402/2740] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:25 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:25.467438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.486461 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6e6db-e430-4812-8b1c-ff66dfe3fb8a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.585689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.586819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.587329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.587967 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.588852 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:25.591407 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:25.709711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1339/2741] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:25 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:25.713963 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.737276 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d659ae-351c-4a0b-9e2a-d9516a1e9288 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.746069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.746768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.747053 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.747374 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.748274 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:25.751153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:25.772515 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1403/2742] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:25.776337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.788500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33e57-8d8b-45af-951c-936db7af99ed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.796404 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.797706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.797706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.798023 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.799000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:25.801017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:25.802280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.811127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:25.820813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1340/2743] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:25.823893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:25.833634 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d1ed-cedc-49ba-966a-8ac81fe1d0ab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.839870 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24af4-665b-4864-a142-e24976a8c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.841580 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24af4-665b-4864-a142-e24976a8c4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.842164 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24af4-665b-4864-a142-e24976a8c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.842796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24af4-665b-4864-a142-e24976a8c4c1 admin admin] PATH_INFO: `/v3/projects/42560edfdbce4922af59914df784931d/users/208640288ebd4fd3b89ebe7fb8fd1546/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.864596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b24af4-665b-4864-a142-e24976a8c4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42560edfdbce4922af59914df784931d, user_id=208640288ebd4fd3b89ebe7fb8fd1546, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:25.871705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b24af4-665b-4864-a142-e24976a8c4c1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:25.936598 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d9593-e3e6-4826-8448-3c17822d42fb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:25.939153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:25.939821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:25.940251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:25.940550 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:25.943023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:25.992884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1341/2744] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:25 2022] PUT /identity/v3/projects/42560edfdbce4922af59914df784931d/users/208640288ebd4fd3b89ebe7fb8fd1546/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:26.003500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:26.003791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:26.004076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:26.065571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:26.067206 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:26.076993 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] MFA Rules not processed for user `208640288ebd4fd3b89ebe7fb8fd1546`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:26.081902 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:26.093962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1404/2745] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:38:26.199324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1342/2746] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:26.200675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:26.219068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dee1-296d-4462-9e0e-6e63ecef113d service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:26.224680 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:26.322255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:26.322255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:26.322255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:26.322255 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:26.322800 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:26.325438 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:26.426692 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:26.427157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1405/2747] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:26 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:26.440503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7157f3-0c57-4b28-9eda-3e323ff904c6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:26.484802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:26.533271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:26.534079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:26.534495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:26.534894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:26.535951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:26.538355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:26.624077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1343/2748] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:26 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:26.627692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:26.641869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac6ae-6c42-4670-8243-7981282743a7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:26.660131 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:26.661161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:26.661537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:26.662794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:26.666631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:26.669802 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:26.687189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1406/2749] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:26.691665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:26.710895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0aa898-9431-407b-a180-bb15b2e31395 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:26.725906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:26.727261 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:26.727643 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:26.728303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] PATH_INFO: `/v3/projects/d5503ffbfc914b2083889b1338907f4d/users/9a8315b37e2f4f99b5ddc4e1e32b17e6/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:26.753272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5503ffbfc914b2083889b1338907f4d, user_id=9a8315b37e2f4f99b5ddc4e1e32b17e6, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:26.756486 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:26.863416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1344/2750] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:26 2022] PUT /identity/v3/projects/d5503ffbfc914b2083889b1338907f4d/users/9a8315b37e2f4f99b5ddc4e1e32b17e6/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:26.867856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:26.886462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1b711-a3a2-40c5-9a29-bb7bd67208a2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:26.964556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7360fb-c37b-4968-9a31-a79a74e0a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:26.966364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7360fb-c37b-4968-9a31-a79a74e0a0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:26.966816 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7360fb-c37b-4968-9a31-a79a74e0a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:26.967333 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7360fb-c37b-4968-9a31-a79a74e0a0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:26.968091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7360fb-c37b-4968-9a31-a79a74e0a0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:26.970060 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7360fb-c37b-4968-9a31-a79a74e0a0bb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:26.995012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1407/2751] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:26.998894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:27.014548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9131-66cc-4895-b502-cca2eb61ea51 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:27.019808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:27.020711 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:27.021000 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:27.021276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] PATH_INFO: `/v3/projects/d5503ffbfc914b2083889b1338907f4d/users/9a8315b37e2f4f99b5ddc4e1e32b17e6/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:27.023709 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5503ffbfc914b2083889b1338907f4d, user_id=9a8315b37e2f4f99b5ddc4e1e32b17e6, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:27.026913 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:27.040312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1345/2752] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:26 2022] PUT /identity/v3/projects/d5503ffbfc914b2083889b1338907f4d/users/9a8315b37e2f4f99b5ddc4e1e32b17e6/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:27.051470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:27.051876 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:27.052258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:27.109381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] MFA Rules not processed for user `9a8315b37e2f4f99b5ddc4e1e32b17e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:27.116470 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:27.282443 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1408/2753] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:27.290952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:27.293183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:27.384608 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8af2e-c9b3-4b51-8ac2-94d9e6863227 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:27.389813 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3865dbf-0e86-4b30-b468-24364b275611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:27.390800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865dbf-0e86-4b30-b468-24364b275611 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:27.391250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865dbf-0e86-4b30-b468-24364b275611 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:27.391686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865dbf-0e86-4b30-b468-24364b275611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:27.404475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3865dbf-0e86-4b30-b468-24364b275611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:27.406845 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3865dbf-0e86-4b30-b468-24364b275611 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:27.421336 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1346/2754] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:27.450719 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:27.456592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:27.529832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d89eb-b1de-40ee-a063-202883c33827 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:27.538268 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:27.540312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:27.540742 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:27.541174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] PATH_INFO: `/v3/users/208640288ebd4fd3b89ebe7fb8fd1546` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:27.543547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208640288ebd4fd3b89ebe7fb8fd1546)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:27.546209 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:27.737595 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208640288ebd4fd3b89ebe7fb8fd1546'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:27.738723 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208640288ebd4fd3b89ebe7fb8fd1546'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:27.763441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208640288ebd4fd3b89ebe7fb8fd1546'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:27.775036 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208640288ebd4fd3b89ebe7fb8fd1546'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:27.876608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208640288ebd4fd3b89ebe7fb8fd1546'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:27.885792 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1409/2755] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:27 2022] DELETE /identity/v3/users/208640288ebd4fd3b89ebe7fb8fd1546 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:27.890403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:27.890685 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:27.890978 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:27.911233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:27.912525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:27.987398 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1347/2756] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:28.000011 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:28.001609 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:28.073433 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b391-b0d3-42d1-ae2a-6881e4720954 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:28.077343 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:28.078155 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:28.078548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:28.078956 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:28.089089 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:28.090746 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:28.107025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1410/2757] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:28.552331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:28.555469 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:28.571810 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b579f5-a067-455b-8dbf-fb713ab1e7a1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:28.576894 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:28.577875 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:28.578195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:28.578481 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] PATH_INFO: `/v3/projects/42560edfdbce4922af59914df784931d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:28.579840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=42560edfdbce4922af59914df784931d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:28.581973 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:28.608036 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:29.128952 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42560edfdbce4922af59914df784931d', 'request_id': 'req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.135808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42560edfdbce4922af59914df784931d', 'request_id': 'req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.141343 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42560edfdbce4922af59914df784931d', 'request_id': 'req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.209530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] The token cache is being invalidate because project 42560edfdbce4922af59914df784931d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:29.210183 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.215138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.215138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1348/2758] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:28 2022] DELETE /identity/v3/projects/42560edfdbce4922af59914df784931d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:29.216141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:29.227086 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c8421-56d4-4b1d-89a5-4dd865557e23 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:29.254435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:29.293174 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:29.294082 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:29.294388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:29.294639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] PATH_INFO: `/v3/users/9a8315b37e2f4f99b5ddc4e1e32b17e6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:29.295841 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8315b37e2f4f99b5ddc4e1e32b17e6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:29.297902 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:29.516308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8315b37e2f4f99b5ddc4e1e32b17e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.516983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8315b37e2f4f99b5ddc4e1e32b17e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.531375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8315b37e2f4f99b5ddc4e1e32b17e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.539882 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8315b37e2f4f99b5ddc4e1e32b17e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.608123 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-580a9728-823c-4623-93d9-817350d491f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8315b37e2f4f99b5ddc4e1e32b17e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:29.615212 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1411/2759] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:29 2022] DELETE /identity/v3/users/9a8315b37e2f4f99b5ddc4e1e32b17e6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:30.147756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:30.150354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:30.165541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c46cc5-8784-40c5-8b61-7a01b6adcbfa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:30.249016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:30.250034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:30.250380 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:30.250722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] PATH_INFO: `/v3/projects/d5503ffbfc914b2083889b1338907f4d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:30.252032 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5503ffbfc914b2083889b1338907f4d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:30.255992 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:30.385919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5503ffbfc914b2083889b1338907f4d', 'request_id': 'req-3357b286-8ac9-466e-9962-610255ed6843'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:30.392631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5503ffbfc914b2083889b1338907f4d', 'request_id': 'req-3357b286-8ac9-466e-9962-610255ed6843'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:30.400831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5503ffbfc914b2083889b1338907f4d', 'request_id': 'req-3357b286-8ac9-466e-9962-610255ed6843'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:30.488907 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] The token cache is being invalidate because project d5503ffbfc914b2083889b1338907f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:30.489202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:30.489868 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3357b286-8ac9-466e-9962-610255ed6843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:30.493005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1349/2760] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:30 2022] DELETE /identity/v3/projects/d5503ffbfc914b2083889b1338907f4d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:30.497737 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:30.498305 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:30.498406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:30.523991 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:30.525322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:30.604442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1412/2761] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:30.613584 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:30.614241 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:30.614747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:30.638090 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:30.640910 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:30.649887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1350/2762] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:30.654499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:30.669007 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff4a4-7535-4631-ad79-b6da8f7f6984 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:30.673915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:30.674828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:30.675125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:30.675404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:30.676293 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:30.676611 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:30.678280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:30.696227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1413/2763] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:38:30.700416 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:30.711452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce858ef-2596-43e1-8d07-1524202e0308 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:30.716502 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:30.717154 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:30.717433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:30.717707 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:30.718442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:30.720360 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:30.826017 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1351/2764] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:30 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:30.826591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:30.837786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa129d0-8865-4404-bb03-76a6d0e25734 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:30.875619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:30.904821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:30.905512 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:30.905790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:30.906105 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:30.906803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:30.909100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.005170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1414/2765] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:30 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:31.009181 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.022418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e5f0b-c5f3-4218-9843-6f28b4387633 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.027325 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.027989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.028283 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.028559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.029321 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.030976 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.039602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:31.048280 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1352/2766] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:31.049591 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.064481 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81135e-d57b-4889-88ab-5460e8ddea4d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.070740 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425176d-644a-4c59-993d-d02b9efc210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.071019 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425176d-644a-4c59-993d-d02b9efc210c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.071376 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425176d-644a-4c59-993d-d02b9efc210c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.071754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425176d-644a-4c59-993d-d02b9efc210c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.072557 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425176d-644a-4c59-993d-d02b9efc210c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.074442 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425176d-644a-4c59-993d-d02b9efc210c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.086558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1415/2767] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:31.091690 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.106322 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb35b9-6671-4949-8ca3-965fae2766a9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.118018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.120138 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.120596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.121139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] PATH_INFO: `/v3/projects/c0308b7b185c4ea9a6547eb10f292a70/users/4ee582aec3294dc7852ab67fe6316bea/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.152788 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0308b7b185c4ea9a6547eb10f292a70, user_id=4ee582aec3294dc7852ab67fe6316bea, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.161386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.248623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1353/2768] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:31 2022] PUT /identity/v3/projects/c0308b7b185c4ea9a6547eb10f292a70/users/4ee582aec3294dc7852ab67fe6316bea/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:31.258965 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.259502 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.259857 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.298275 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] MFA Rules not processed for user `4ee582aec3294dc7852ab67fe6316bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:31.300153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:31.384251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1416/2769] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:31.387846 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.473971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253bbf-9adc-4061-8e01-b077e466aa91 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.483149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.483936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.484327 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.484714 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.485530 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.487688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.609153 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1354/2770] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:31 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:31.610272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.625144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253c38-1f6b-442d-bcb9-93bf8a04440d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.705233 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.706041 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.706741 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.707133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.707969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.710193 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.786017 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1417/2771] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:31 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:31.790163 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.801548 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fea92a-446a-4bfd-9dac-f8bdc36f31f8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.806847 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.807605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.807921 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.808202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.808954 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.810694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:31.839063 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1355/2772] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:31.841072 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:31.852971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abada89-0623-44d2-9f2b-e826e3bf1093 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:31.858467 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:31.859487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:31.859780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:31.860099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] PATH_INFO: `/v3/projects/dc10d0ef7e9e49b9865e5e8045d6b97a/users/e1ef241cca514f13810a22bb5199918f/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:31.878655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc10d0ef7e9e49b9865e5e8045d6b97a, user_id=e1ef241cca514f13810a22bb5199918f, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:31.881491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:32.168194 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1418/2773] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:31 2022] PUT /identity/v3/projects/dc10d0ef7e9e49b9865e5e8045d6b97a/users/e1ef241cca514f13810a22bb5199918f/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:32.172240 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:32.189655 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4914-3b0b-426d-9abc-62d796937938 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:32.254449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26631b7-6bac-4257-9436-353710cc191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:32.255314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26631b7-6bac-4257-9436-353710cc191a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:32.255609 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26631b7-6bac-4257-9436-353710cc191a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:32.255886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26631b7-6bac-4257-9436-353710cc191a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:32.256606 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26631b7-6bac-4257-9436-353710cc191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:32.258857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26631b7-6bac-4257-9436-353710cc191a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:32.269403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1356/2774] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:32.273656 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:32.285539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412004-dc59-4531-9098-054d7c737b63 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:32.291219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:32.292120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:32.292407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:32.292691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] PATH_INFO: `/v3/projects/dc10d0ef7e9e49b9865e5e8045d6b97a/users/e1ef241cca514f13810a22bb5199918f/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:32.294761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc10d0ef7e9e49b9865e5e8045d6b97a, user_id=e1ef241cca514f13810a22bb5199918f, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:32.297575 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:32.300204 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:32.318450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1419/2775] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:32 2022] PUT /identity/v3/projects/dc10d0ef7e9e49b9865e5e8045d6b97a/users/e1ef241cca514f13810a22bb5199918f/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:32.323858 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6abb7c-39c1-42ba-85fe-8a759e58ce03 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:32.324598 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6abb7c-39c1-42ba-85fe-8a759e58ce03 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:32.325116 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6abb7c-39c1-42ba-85fe-8a759e58ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:32.365175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1f6abb7c-39c1-42ba-85fe-8a759e58ce03 None None] MFA Rules not processed for user `e1ef241cca514f13810a22bb5199918f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:32.366464 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1f6abb7c-39c1-42ba-85fe-8a759e58ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:32.413704 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:32.467579 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1357/2776] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:32.478711 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:32.480689 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:32.568039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b78d-1e5b-4b66-af60-7cfab93a75cf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:32.572134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:32.572928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:32.573208 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:32.573480 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:32.583989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:32.585446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:32.596861 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1420/2777] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:33.214205 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:33.214705 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:33.214803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:33.232394 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] MFA Rules not processed for user `2e8dcd06c87e4907a208bdd8afc3d01c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:33.233627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:33.299206 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1358/2778] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:33.576632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:33.578555 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:33.686900 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51836174-8536-449b-8ee5-cccf7a27903e service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:33.697261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:33.698013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:33.702487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:33.702487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:33.702487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:33.715231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:33.715231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0671-13f8-4e36-983d-13f27d6f7830 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:33.716627 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:33.727461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1421/2779] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:33.794575 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688517-9e59-4e62-99f4-c55a3f8ca35e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:33.799187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:33.800054 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:33.800330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:33.800602 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] PATH_INFO: `/v3/users/4ee582aec3294dc7852ab67fe6316bea` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:33.801783 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee582aec3294dc7852ab67fe6316bea)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:33.803793 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:34.019157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee582aec3294dc7852ab67fe6316bea'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.033329 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee582aec3294dc7852ab67fe6316bea'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.081945 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee582aec3294dc7852ab67fe6316bea'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.087808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:34.090098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee582aec3294dc7852ab67fe6316bea'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.090752 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee582aec3294dc7852ab67fe6316bea'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.096615 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1359/2780] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:33 2022] DELETE /identity/v3/users/4ee582aec3294dc7852ab67fe6316bea => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:34.101097 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:34.101967 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:34.106896 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:34.120148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:34.121239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:34.184205 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1422/2781] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:34.194791 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:34.196310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:34.268210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03f1d-47b7-4b1f-b532-d37a4e3513c3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:34.271957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:34.272626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:34.272905 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:34.273179 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:34.283272 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:34.285035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:34.296587 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1360/2782] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:34.677576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:34.679120 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:34.692051 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a8634-c776-4f9d-b8cb-834189116de5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:34.697225 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:34.698258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:34.698546 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:34.698856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] PATH_INFO: `/v3/projects/c0308b7b185c4ea9a6547eb10f292a70` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:34.705192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0308b7b185c4ea9a6547eb10f292a70)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:34.707219 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:34.839670 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:34.849616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0308b7b185c4ea9a6547eb10f292a70', 'request_id': 'req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.950574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0308b7b185c4ea9a6547eb10f292a70', 'request_id': 'req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.957312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0308b7b185c4ea9a6547eb10f292a70', 'request_id': 'req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.968903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] The token cache is being invalidate because project c0308b7b185c4ea9a6547eb10f292a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:34.969189 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.969879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:34.971431 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1423/2783] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:34 2022] DELETE /identity/v3/projects/c0308b7b185c4ea9a6547eb10f292a70 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:34.975551 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:34.986262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6395d-1912-4643-973a-e821dc8bef21 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:35.042724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:35.043507 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:35.043819 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:35.044064 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] PATH_INFO: `/v3/users/e1ef241cca514f13810a22bb5199918f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:35.045258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ef241cca514f13810a22bb5199918f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:35.047237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:35.233953 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ef241cca514f13810a22bb5199918f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:35.246403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ef241cca514f13810a22bb5199918f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:35.322242 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ef241cca514f13810a22bb5199918f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:35.331848 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ef241cca514f13810a22bb5199918f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:35.332777 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5043ef-e4b8-4aca-af99-8e4e9a8adb91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ef241cca514f13810a22bb5199918f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:35.339433 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1361/2784] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:34 2022] DELETE /identity/v3/users/e1ef241cca514f13810a22bb5199918f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:35.780586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:35.785093 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:35.798245 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff23a9a-0944-4e3a-8b18-589cb8fa138a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:35.860371 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:35.861326 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:35.861608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:35.861912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] PATH_INFO: `/v3/projects/dc10d0ef7e9e49b9865e5e8045d6b97a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:35.863134 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc10d0ef7e9e49b9865e5e8045d6b97a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:35.865054 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:35.964608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc10d0ef7e9e49b9865e5e8045d6b97a', 'request_id': 'req-e514dde0-d4cb-4223-ad7f-8e706536e0d1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:36.053280 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc10d0ef7e9e49b9865e5e8045d6b97a', 'request_id': 'req-e514dde0-d4cb-4223-ad7f-8e706536e0d1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:36.061692 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc10d0ef7e9e49b9865e5e8045d6b97a', 'request_id': 'req-e514dde0-d4cb-4223-ad7f-8e706536e0d1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:36.074154 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] The token cache is being invalidate because project dc10d0ef7e9e49b9865e5e8045d6b97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:36.074715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:36.075417 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e514dde0-d4cb-4223-ad7f-8e706536e0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:36.077383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1424/2785] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:35 2022] DELETE /identity/v3/projects/dc10d0ef7e9e49b9865e5e8045d6b97a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:36.086870 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.087235 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.087610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.112282 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:36.113438 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:36.127227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:36.174988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1362/2786] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:36.183352 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.183710 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.184016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.202733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:36.203938 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:36.212584 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1425/2787] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:36.217043 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.226989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0390453-2edf-42ed-a012-b59f0a402290 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.232448 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.233132 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.233418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.233698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.234470 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:36.234782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.236563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:36.249027 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1363/2788] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:38:36.253427 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.262825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8ed1-09dc-4379-96be-2b8ae793f767 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.267472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.268117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.268459 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.268883 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.269592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.271540 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:36.416300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1426/2789] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:36 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:36.421167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.436165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201423c-e7c7-4b3b-beca-061e5cfee18e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.490563 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.491341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.491626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.491904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.492596 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.494737 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:36.594835 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1364/2790] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:36 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:36.596039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.607691 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3215ee-0b8f-4049-bb91-8ae3154e44ee admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.613050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.613803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.614195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.614762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.615637 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.617437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:36.629240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1427/2791] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:36.633300 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.643840 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed0a63-3fc6-41e8-a174-ec5dd48a6d06 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.648666 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980f5fd-820b-40c9-8fd5-63efdd9a1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.649328 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f5fd-820b-40c9-8fd5-63efdd9a1556 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.649624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f5fd-820b-40c9-8fd5-63efdd9a1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.649904 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f5fd-820b-40c9-8fd5-63efdd9a1556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.651232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980f5fd-820b-40c9-8fd5-63efdd9a1556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.652903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980f5fd-820b-40c9-8fd5-63efdd9a1556 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:36.668473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.669529 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1365/2792] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:36.679990 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891dde-6f46-4187-a9d4-1f4639dea36a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.685658 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.686814 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.687100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.687382 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] PATH_INFO: `/v3/projects/49bd7f18e1e6449c898d2bc927dd1fb4/users/cb195923f86842e495f3f69d91fbc0c7/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.701114 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:36.705366 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bd7f18e1e6449c898d2bc927dd1fb4, user_id=cb195923f86842e495f3f69d91fbc0c7, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.708113 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:36.769090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1428/2793] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:36 2022] PUT /identity/v3/projects/49bd7f18e1e6449c898d2bc927dd1fb4/users/cb195923f86842e495f3f69d91fbc0c7/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:36.780224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123eba-b3e8-4be3-9ab6-b6ab76a7cba6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.780519 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123eba-b3e8-4be3-9ab6-b6ab76a7cba6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.780804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123eba-b3e8-4be3-9ab6-b6ab76a7cba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.813500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b4123eba-b3e8-4be3-9ab6-b6ab76a7cba6 None None] MFA Rules not processed for user `cb195923f86842e495f3f69d91fbc0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:36.814559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b4123eba-b3e8-4be3-9ab6-b6ab76a7cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:36.911482 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:36.916960 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1366/2794] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:36.979453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f13e6-f1ee-4fea-8c65-062b1b654550 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:36.984501 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:36.985626 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:36.985913 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:36.986249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:36.986958 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:36.988881 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.039471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.039784 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.040071 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.059802 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:37.061031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:37.072320 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:37.077319 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1429/2795] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:36 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:37.078917 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.137679 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1367/2796] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:38:37.153885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.155490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:37.164324 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb509-f2df-4160-b377-92cdd71b2d23 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.170509 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.170836 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.171224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.171699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.172491 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.174623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.227195 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1305d-1872-4edb-a2e2-616fb7f439dc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.257909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1430/2797] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:37 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:38:37.258868 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.269780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fbf9-3086-48de-a06d-a099cab3cd04 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.297392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.298079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.298822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.298822 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.299704 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.300387 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.300672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.300948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.302192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.303447 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.319378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1431/2798] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:37.327092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.337928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe4b0-ae68-4095-9619-cf7f5926a4c9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.349013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.350251 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.351803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.359254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] PATH_INFO: `/v3/projects/8de76e8eb2924d04af08ea9a2fb6f412/users/42afca2caa6a44e79fe273ff594f2800/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.389243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de76e8eb2924d04af08ea9a2fb6f412, user_id=42afca2caa6a44e79fe273ff594f2800, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.393437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.402750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.405431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.420733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1368/2799] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:38:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 12:38:37.492378 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1432/2800] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:37 2022] PUT /identity/v3/projects/8de76e8eb2924d04af08ea9a2fb6f412/users/42afca2caa6a44e79fe273ff594f2800/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:37.493639 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.499285 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:37.505576 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237fcd-e98a-41be-9b3d-b243ba898694 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.574625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61407dc8-5474-4692-be5b-2c53c12b504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.575310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407dc8-5474-4692-be5b-2c53c12b504b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.575593 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407dc8-5474-4692-be5b-2c53c12b504b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.575872 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407dc8-5474-4692-be5b-2c53c12b504b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.576672 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61407dc8-5474-4692-be5b-2c53c12b504b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.578540 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61407dc8-5474-4692-be5b-2c53c12b504b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.593537 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1369/2801] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:37.597862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.614033 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915f1ad-18ca-48e0-aa16-846f5be4a2c3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.621971 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.622969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.623258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.623587 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] PATH_INFO: `/v3/projects/8de76e8eb2924d04af08ea9a2fb6f412/users/42afca2caa6a44e79fe273ff594f2800/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.635639 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de76e8eb2924d04af08ea9a2fb6f412, user_id=42afca2caa6a44e79fe273ff594f2800, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.642300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.682889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1433/2802] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:37 2022] PUT /identity/v3/projects/8de76e8eb2924d04af08ea9a2fb6f412/users/42afca2caa6a44e79fe273ff594f2800/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:37.695700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.696273 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.696554 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.725244 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] MFA Rules not processed for user `42afca2caa6a44e79fe273ff594f2800`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:37.726491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:37.795727 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1370/2803] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:37.806707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:37.808877 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:37.829383 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:37.867252 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860f78-e627-4aa2-85c9-4923369858e8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:37.873553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ecb1-e7c9-4606-98a7-433a5a92964a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:37.874239 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ecb1-e7c9-4606-98a7-433a5a92964a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:37.874530 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ecb1-e7c9-4606-98a7-433a5a92964a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:37.874838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ecb1-e7c9-4606-98a7-433a5a92964a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:37.933005 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ecb1-e7c9-4606-98a7-433a5a92964a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:37.934504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ecb1-e7c9-4606-98a7-433a5a92964a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:37.943500 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1434/2804] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:41.167944 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:41.246917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5f60-91d4-456f-9eeb-9834d8671233 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:41.252919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:41.253798 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:41.254112 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:41.254393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] PATH_INFO: `/v3/users/cb195923f86842e495f3f69d91fbc0c7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:41.256208 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb195923f86842e495f3f69d91fbc0c7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:41.258192 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:41.362814 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:41.473439 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb195923f86842e495f3f69d91fbc0c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:41.486225 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb195923f86842e495f3f69d91fbc0c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:41.556491 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb195923f86842e495f3f69d91fbc0c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:41.565739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb195923f86842e495f3f69d91fbc0c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:41.566794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb195923f86842e495f3f69d91fbc0c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:41.573893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1371/2805] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:41 2022] DELETE /identity/v3/users/cb195923f86842e495f3f69d91fbc0c7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:41.578563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:41.579441 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:41.579797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:41.598147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:41.599375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:41.665850 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1435/2806] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:41.674693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:41.676269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:41.741451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5dba8-971e-4683-adeb-a7ca0f493229 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:41.745072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:41.745762 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:41.746076 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:41.746359 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:41.759311 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:41.761127 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:41.772346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1372/2807] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:38:42.169285 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:42.170833 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:42.185256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3fa32-dfe3-4e26-bd1a-cfbdf92cdfd1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:42.194423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:42.195314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:42.195666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:42.195952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] PATH_INFO: `/v3/projects/49bd7f18e1e6449c898d2bc927dd1fb4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:42.197298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bd7f18e1e6449c898d2bc927dd1fb4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:42.199322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:42.327627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bd7f18e1e6449c898d2bc927dd1fb4', 'request_id': 'req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.395981 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bd7f18e1e6449c898d2bc927dd1fb4', 'request_id': 'req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.403731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bd7f18e1e6449c898d2bc927dd1fb4', 'request_id': 'req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.410622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:42.418872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] The token cache is being invalidate because project 49bd7f18e1e6449c898d2bc927dd1fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:42.419168 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.419840 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.421423 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1436/2808] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:42 2022] DELETE /identity/v3/projects/49bd7f18e1e6449c898d2bc927dd1fb4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:42.425490 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:42.446463 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c7ad-61ca-45e4-81bb-8f15730972fd service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:42.524330 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:42.525947 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:42.526342 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:42.526694 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] PATH_INFO: `/v3/users/42afca2caa6a44e79fe273ff594f2800` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:42.528173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42afca2caa6a44e79fe273ff594f2800)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:42.530489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:42.862787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42afca2caa6a44e79fe273ff594f2800'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.864100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:42.877176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42afca2caa6a44e79fe273ff594f2800'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.927787 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42afca2caa6a44e79fe273ff594f2800'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.936339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42afca2caa6a44e79fe273ff594f2800'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.937053 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a782c377-2f0f-488c-bcc1-341d3d95ddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42afca2caa6a44e79fe273ff594f2800'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:42.946077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1373/2809] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:38:42 2022] DELETE /identity/v3/users/42afca2caa6a44e79fe273ff594f2800 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:43.829798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:43.833461 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:43.851170 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc85fac-3d73-41bd-a9b1-cb6dd0f150d6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:43.918230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:43.919027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:43.919309 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:43.919573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] PATH_INFO: `/v3/projects/8de76e8eb2924d04af08ea9a2fb6f412` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:43.920787 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de76e8eb2924d04af08ea9a2fb6f412)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:43.922767 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.035146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de76e8eb2924d04af08ea9a2fb6f412', 'request_id': 'req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:44.099563 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de76e8eb2924d04af08ea9a2fb6f412', 'request_id': 'req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:44.108444 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de76e8eb2924d04af08ea9a2fb6f412', 'request_id': 'req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:44.122677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] The token cache is being invalidate because project 8de76e8eb2924d04af08ea9a2fb6f412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:38:44.122970 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:44.123749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b4ebdc3d-ea84-4265-b256-5ab82e9dd74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:38:44.125608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1437/2810] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:38:43 2022] DELETE /identity/v3/projects/8de76e8eb2924d04af08ea9a2fb6f412 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:44.131400 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.131917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.132156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.154028 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:44.161628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:44.228689 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1374/2811] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:44.234359 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.234722 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.234989 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.254618 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:44.256025 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:44.265091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1438/2812] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:44.269418 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:44.280961 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba26fc-9bde-4615-ac54-8fa1f02d4dfb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:44.286130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:44.286799 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.287083 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.287361 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.288180 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:38:44.288485 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:44.290129 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.302795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1375/2813] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:38:44.307951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:44.325537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7642d9-17fe-4abb-9714-fc1b40cc99ff None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:44.330794 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:44.331761 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.332124 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.332775 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.333753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:44.335855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.421849 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1439/2814] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:38:44 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:44.425650 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:44.436141 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269f6b-1a70-4526-ab92-47aff6e042ef admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:44.497052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:44.497645 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.497925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.498232 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.498933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:44.500873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.580498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1376/2815] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:38:44 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:38:44.584627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:44.596259 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e52625-93d9-488b-abaa-00c6bc622813 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:44.601135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:44.601852 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.602190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.602474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.603524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:44.605039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.616712 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1440/2816] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:44.621370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:44.634544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9ab1-fff3-4940-a938-20bf9a2787f0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:44.641008 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ff61b-b1fb-46eb-94dd-1b67e09beeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:44.641742 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ff61b-b1fb-46eb-94dd-1b67e09beeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.642120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ff61b-b1fb-46eb-94dd-1b67e09beeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.647257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ff61b-b1fb-46eb-94dd-1b67e09beeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.647257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ff61b-b1fb-46eb-94dd-1b67e09beeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:44.647257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ff61b-b1fb-46eb-94dd-1b67e09beeb8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.658037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1377/2817] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:38:44.660666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:44.671931 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c7731-89de-456d-b070-7e2f5d0f4d08 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:44.677735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:44.679012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.679298 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.679574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] PATH_INFO: `/v3/projects/72bbf20ab89344f68de81840be928b68/users/910b0e364f30444d914d58ead43a0a0f/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.711625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bbf20ab89344f68de81840be928b68, user_id=910b0e364f30444d914d58ead43a0a0f, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:44.714471 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:44.845903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1441/2818] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:38:44 2022] PUT /identity/v3/projects/72bbf20ab89344f68de81840be928b68/users/910b0e364f30444d914d58ead43a0a0f/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:38:44.856218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a043-5ccf-4a29-aa0c-d523b5e2053b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:44.856544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a043-5ccf-4a29-aa0c-d523b5e2053b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:44.856891 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a043-5ccf-4a29-aa0c-d523b5e2053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:44.891104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3e62a043-5ccf-4a29-aa0c-d523b5e2053b None None] MFA Rules not processed for user `910b0e364f30444d914d58ead43a0a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:44.899881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3e62a043-5ccf-4a29-aa0c-d523b5e2053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:44.922889 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:44.978037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1378/2819] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:44.993081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:45.002880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:45.022337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:45.061347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5a89-cc8f-40e7-9fee-7e5247202921 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:45.065068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:45.065716 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:45.066009 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:45.066307 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:45.075629 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:45.077100 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:45.086681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1442/2820] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:47.859729 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:47.860258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:47.860258 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:47.877646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] MFA Rules not processed for user `910b0e364f30444d914d58ead43a0a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:47.878890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:47.885803 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1379/2821] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:49.532099 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:49.534029 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:49.607008 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88310a-9b43-4202-8d70-5b9bf897a72a service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:49.610729 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:49.611390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:49.611744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:49.612055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:49.613888 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:49.625701 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:49.627179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdf4cf-829e-4a4d-9864-f3e8216ba91e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:49.637227 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1443/2822] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:50.568306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:50.570047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:50.650050 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e6c38-c0be-4005-949b-15b6b6a30405 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:50.657472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:50.667147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:50.667147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:50.667147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:50.667147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:50.677574 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:50.679249 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:50.691831 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1380/2823] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:51.827425 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:51.827962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:51.828488 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:51.845856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] MFA Rules not processed for user `0b8f1907721c44e1b7df1aeb451bdd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:38:51.847316 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:51.904577 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1444/2824] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:38:52.805628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:52.809020 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:52.887918 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebdaf6-adc8-440e-8663-9888a0e4d888 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:52.893392 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:52.894092 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:52.894386 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:52.894676 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:52.896660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:52.910210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:52.911843 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:52.922919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1381/2825] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:38:56.807655 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:38:56.809084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:56.826231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd336-1187-43c2-b7f1-c1825eeedcb2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:38:56.831667 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:38:56.832311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:38:56.832594 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:38:56.832869 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:38:56.834668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:38:56.847364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:38:56.848983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:38:56.860318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1445/2826] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:02.918184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:05.797277 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:05.812794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95db09-d8dd-4cd0-889f-6dfea74fec37 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:05.826436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:05.826436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:05.826436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:05.826436 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:05.826740 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:05.845078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:05.845078 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650c05c-0483-48c2-96f6-42cda39025ad service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:05.862224 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1382/2827] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:06.855549 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=74 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:10.982171 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:10.983641 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:10.995115 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca1cf-2924-4ec9-b13a-264460eb7420 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:10.998855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:10.999499 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:10.999784 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:11.000083 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:11.001812 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:11.063717 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:11.065149 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:11.074890 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1446/2828] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:11.764513 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108554-e24b-4a6f-bed6-6899621c496f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:11.765026 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108554-e24b-4a6f-bed6-6899621c496f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:11.765150 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108554-e24b-4a6f-bed6-6899621c496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:11.784723 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-26108554-e24b-4a6f-bed6-6899621c496f None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:11.786158 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-26108554-e24b-4a6f-bed6-6899621c496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:11.846724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1383/2829] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:39:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:11.859586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:11.861231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:11.936727 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf517-be32-46f9-88d2-73bc60bec185 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:11.941984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:11.942700 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:11.942985 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:11.943265 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:11.953195 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:11.954846 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:11.963648 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1447/2830] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:12.846573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a1d1-e229-47c5-8c97-e8445b8f6e18 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:12.847046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a1d1-e229-47c5-8c97-e8445b8f6e18 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:12.847147 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a1d1-e229-47c5-8c97-e8445b8f6e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:12.866674 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e655a1d1-e229-47c5-8c97-e8445b8f6e18 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:12.867898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e655a1d1-e229-47c5-8c97-e8445b8f6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:12.875767 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1384/2831] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jun 20 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:12.891092 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:12.902108 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c511cc-34b9-4cfd-8b15-520b2e4eafca service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:12.907677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:12.911489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:12.911489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:12.911489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:12.918853 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:12.920625 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:12.930864 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1448/2832] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:13.583989 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac554-83fd-4862-8f4b-270a5dbcd804 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:13.584279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac554-83fd-4862-8f4b-270a5dbcd804 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:13.584557 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac554-83fd-4862-8f4b-270a5dbcd804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:13.602898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cd0ac554-83fd-4862-8f4b-270a5dbcd804 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:13.604120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cd0ac554-83fd-4862-8f4b-270a5dbcd804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:13.612441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1385/2833] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:13.624336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:13.634894 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98bade-4468-4924-a98b-e536966ff85d service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:13.639969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:13.640619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:13.640898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:13.641173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:13.651244 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:13.652843 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:13.670715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1449/2834] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:14.370539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629e26-844d-4316-9798-bb60a53ff0e5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:14.371079 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629e26-844d-4316-9798-bb60a53ff0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:14.371184 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629e26-844d-4316-9798-bb60a53ff0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:14.391290 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-da629e26-844d-4316-9798-bb60a53ff0e5 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:14.392559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-da629e26-844d-4316-9798-bb60a53ff0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:14.400159 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1386/2835] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jun 20 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:14.412735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:14.423675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd3aaf-2501-4e19-9bb6-9c4984387fc4 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:14.428829 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:14.429484 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:14.429768 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:14.430084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:14.439713 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:14.441437 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:14.451969 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1450/2836] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:16.728441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:16.728886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:16.728991 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:16.747489 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:16.748782 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:16.756306 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1387/2837] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jun 20 12:39:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:16.769347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:16.780793 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6451115-a5e6-411f-86d8-ce249920b6c9 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:16.785910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69f25-a68a-4e20-b8ac-80d4fb849de3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:16.786714 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69f25-a68a-4e20-b8ac-80d4fb849de3 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:16.787271 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69f25-a68a-4e20-b8ac-80d4fb849de3 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:16.787582 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69f25-a68a-4e20-b8ac-80d4fb849de3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:16.796109 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b69f25-a68a-4e20-b8ac-80d4fb849de3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:16.797707 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b69f25-a68a-4e20-b8ac-80d4fb849de3 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:16.806586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1451/2838] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:39:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:17.288836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:17.456555 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d7b93-4b79-4714-a1a3-79e41c7ef82b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:17.461736 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:17.462663 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:17.462998 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:17.463278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] PATH_INFO: `/v3/users/910b0e364f30444d914d58ead43a0a0f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:17.464520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=910b0e364f30444d914d58ead43a0a0f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:17.466610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:17.760314 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910b0e364f30444d914d58ead43a0a0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:17.788912 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910b0e364f30444d914d58ead43a0a0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:17.792873 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:17.906567 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910b0e364f30444d914d58ead43a0a0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:17.921046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910b0e364f30444d914d58ead43a0a0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:17.922458 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910b0e364f30444d914d58ead43a0a0f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:17.930925 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1388/2839] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:39:17 2022] DELETE /identity/v3/users/910b0e364f30444d914d58ead43a0a0f => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:17.935161 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:17.937094 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:17.937631 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:17.974028 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:17.975996 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:18.018341 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:18.071756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1452/2840] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:39:18.082524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:18.084233 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:18.191214 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb61fc0-2679-42f0-a33b-7fcab314fda4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:18.199213 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7dc5-a77d-4f68-b90b-63f85274241e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:18.200425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7dc5-a77d-4f68-b90b-63f85274241e service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:18.200951 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7dc5-a77d-4f68-b90b-63f85274241e service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:18.201442 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7dc5-a77d-4f68-b90b-63f85274241e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:18.212633 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce7dc5-a77d-4f68-b90b-63f85274241e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:18.214552 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce7dc5-a77d-4f68-b90b-63f85274241e service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:18.240152 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1389/2841] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:18.541818 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:18.543845 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:18.562436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306e61-2317-444e-a59e-0998b3ffc0c7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:18.568190 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:18.569753 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:18.570337 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:18.570804 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] PATH_INFO: `/v3/projects/72bbf20ab89344f68de81840be928b68` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:18.572070 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bbf20ab89344f68de81840be928b68)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:18.573982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:18.727388 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bbf20ab89344f68de81840be928b68', 'request_id': 'req-7c693ec5-b784-4b57-89ed-3db43907d2e9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:18.807619 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bbf20ab89344f68de81840be928b68', 'request_id': 'req-7c693ec5-b784-4b57-89ed-3db43907d2e9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:18.816862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bbf20ab89344f68de81840be928b68', 'request_id': 'req-7c693ec5-b784-4b57-89ed-3db43907d2e9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:18.831919 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] The token cache is being invalidate because project 72bbf20ab89344f68de81840be928b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:39:18.832232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:18.833055 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c693ec5-b784-4b57-89ed-3db43907d2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:18.839050 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1453/2842] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:39:18 2022] DELETE /identity/v3/projects/72bbf20ab89344f68de81840be928b68 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:18.845212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:18.846271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:18.846660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:18.867659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:18.869178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:18.973100 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1390/2843] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:18.985489 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:18.985986 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:18.986159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.023286 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:19.024514 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:19.035544 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1454/2844] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:19.040760 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.054892 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422110-2854-4bed-86c1-ac4461492ddb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.061741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.062565 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.063115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.063524 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.064260 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:39:19.064636 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.066816 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.087252 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1391/2845] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:39:19.088748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.100261 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084fb95-f0c0-4d93-ae8d-febda3e64afc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.110473 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.111666 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.112173 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.112684 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.113592 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.115909 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.221695 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1455/2846] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:39:19 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:39:19.226528 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.238337 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770d04-9f7e-4ebb-8b88-e42065303ad5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.304005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.304686 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.305031 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.305317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.306042 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.307988 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.385908 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1392/2847] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:39:19 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:39:19.389744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.404263 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c87f-ee9b-4af9-bf98-7c50485fd995 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.409391 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.410103 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.410445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.410668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.411407 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.413059 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.428419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1456/2848] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:39:19.429670 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.436657 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:19.442015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf586c-09d0-46c4-a69c-e94680737490 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.450219 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d89bb9-b4e9-4ba4-ac6f-7dd143680e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.451037 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d89bb9-b4e9-4ba4-ac6f-7dd143680e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.455781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d89bb9-b4e9-4ba4-ac6f-7dd143680e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.455781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d89bb9-b4e9-4ba4-ac6f-7dd143680e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.455781 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d89bb9-b4e9-4ba4-ac6f-7dd143680e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.456157 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d89bb9-b4e9-4ba4-ac6f-7dd143680e69 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.471535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1393/2849] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:39:19.472504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.484380 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377f21-14c6-417d-afd1-d4cd012eef0c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.489777 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.490929 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.494503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.494503 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] PATH_INFO: `/v3/projects/9b4a9334c1f642fb8ed36d6e87d09a01/users/e9a9ac5edcf6467a87b9095abed1b07a/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.509135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4a9334c1f642fb8ed36d6e87d09a01, user_id=e9a9ac5edcf6467a87b9095abed1b07a, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.512015 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.574081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1457/2850] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:39:19 2022] PUT /identity/v3/projects/9b4a9334c1f642fb8ed36d6e87d09a01/users/e9a9ac5edcf6467a87b9095abed1b07a/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:19.576149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a10a-a52d-416f-85bd-6705688804df None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.576534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a10a-a52d-416f-85bd-6705688804df None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.577005 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a10a-a52d-416f-85bd-6705688804df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.595903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4e87a10a-a52d-416f-85bd-6705688804df None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:19.597227 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4e87a10a-a52d-416f-85bd-6705688804df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:19.665370 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1394/2851] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:39:19.677334 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:19.685681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:19.765507 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440128-f3e2-407f-89a9-16a7eb75db0c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:19.769683 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:19.770468 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:19.770832 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:19.771185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:19.777521 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:19.782679 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:19.784458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:19.803673 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1458/2852] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:21.204333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7b543-ea5b-4122-ada2-24b3d93d44f8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:21.208187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7b543-ea5b-4122-ada2-24b3d93d44f8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:21.208187 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7b543-ea5b-4122-ada2-24b3d93d44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:21.240919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dec7b543-ea5b-4122-ada2-24b3d93d44f8 None None] MFA Rules not processed for user `e9a9ac5edcf6467a87b9095abed1b07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:21.242778 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dec7b543-ea5b-4122-ada2-24b3d93d44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:21.348535 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1395/2853] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:39:21.362247 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:21.365258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:21.445744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f534df-f270-4624-bf2f-d7d7050584c4 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:21.450446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3667-fcf4-4693-ba58-d7a8c7b018b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f08d1a5b8e594901b986f1bde71e015a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:21.451479 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3667-fcf4-4693-ba58-d7a8c7b018b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:21.452078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3667-fcf4-4693-ba58-d7a8c7b018b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:21.452588 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3667-fcf4-4693-ba58-d7a8c7b018b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:21.463910 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3667-fcf4-4693-ba58-d7a8c7b018b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:21.465755 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3667-fcf4-4693-ba58-d7a8c7b018b6 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:21.477396 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1459/2854] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:23.314341 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:23.314928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:23.314928 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:23.336168 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] MFA Rules not processed for user `e9a9ac5edcf6467a87b9095abed1b07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:23.337410 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:23.345279 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1396/2855] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:31.471703 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=29 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:33.329757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=65 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:34.444962 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:34.445453 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:34.445560 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:34.463153 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:34.464347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:34.532254 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1460/2856] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jun 20 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:34.544800 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:34.546250 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:34.620546 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428806-0064-49ed-b346-e6a0b841b2ab None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:34.626269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:34.626850 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:34.627149 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:34.627414 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:34.635883 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:34.638354 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:34.647044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1397/2857] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:37.689654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:37.691177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:37.708404 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8714db-442c-457c-b55f-3a28675c5d3e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:37.718146 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:37.719121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:37.719402 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:37.719681 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] PATH_INFO: `/v3/users/0b8f1907721c44e1b7df1aeb451bdd3a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:37.720980 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8f1907721c44e1b7df1aeb451bdd3a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:37.722977 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:37.923622 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8f1907721c44e1b7df1aeb451bdd3a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:37.924269 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8f1907721c44e1b7df1aeb451bdd3a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:37.936537 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8f1907721c44e1b7df1aeb451bdd3a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:37.943472 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8f1907721c44e1b7df1aeb451bdd3a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.023961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e522ed1c-3107-4e4d-bed5-21fccd8912e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8f1907721c44e1b7df1aeb451bdd3a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.030156 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1461/2858] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:39:37 2022] DELETE /identity/v3/users/0b8f1907721c44e1b7df1aeb451bdd3a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:38.334253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:38.349185 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf29992-005e-4e11-ac92-63ad2fcc6c17 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:38.410886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:38.411887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:38.412174 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:38.412453 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] PATH_INFO: `/v3/projects/ae4fd6d1c4cc414284f346ec31ca5432` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:38.413733 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4fd6d1c4cc414284f346ec31ca5432)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:38.415724 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:38.540245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4fd6d1c4cc414284f346ec31ca5432', 'request_id': 'req-1712e3cb-9883-4125-b4a7-f0b7b1703a48'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.547302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4fd6d1c4cc414284f346ec31ca5432', 'request_id': 'req-1712e3cb-9883-4125-b4a7-f0b7b1703a48'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.553018 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4fd6d1c4cc414284f346ec31ca5432', 'request_id': 'req-1712e3cb-9883-4125-b4a7-f0b7b1703a48'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.618264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] The token cache is being invalidate because project ae4fd6d1c4cc414284f346ec31ca5432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:39:38.618697 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.619333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1712e3cb-9883-4125-b4a7-f0b7b1703a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:39:38.621094 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1398/2859] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:39:38 2022] DELETE /identity/v3/projects/ae4fd6d1c4cc414284f346ec31ca5432 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:38.627296 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:38.630585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:38.630585 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:38.646181 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:38.647386 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:38.706825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1462/2860] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:38.714946 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:38.715886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:38.716167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:38.734885 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:38.736139 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:38.744377 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1399/2861] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:38.748733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:38.758634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b643-6945-4790-8540-f5e4bef63441 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:38.763657 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:38.764302 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:38.764581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:38.764856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:38.765608 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:39:38.765912 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:38.767558 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:38.783780 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1463/2862] 10.222.0.70 () {58 vars in 1152 bytes} [Mon Jun 20 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:39:38.784867 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:38.794115 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be4e77-ad4c-4243-890b-9d2be83cc383 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:38.799041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:38.799734 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:38.800067 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:38.800344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:38.801209 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:38.803170 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:38.813901 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:38.894877 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1400/2863] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:39:38 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:39:38.899073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:38.905539 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:38.912117 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26610b-f759-4439-aa37-d806c18f458e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:38.966322 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:38.967000 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:38.967288 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:38.967569 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:38.968270 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:38.970242 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:39.082031 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1464/2864] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:39:38 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:39:39.086091 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:39.097167 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eefa3-a989-4ba1-a18b-4317dddfec21 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:39.101881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:39.102610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:39.102898 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:39.103176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:39.103906 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:39.105533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:39.116750 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1401/2865] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:39:39.120735 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:39.131825 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaaea-448d-4d84-a3a6-8dcc5296c01a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:39.136668 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f01660-9008-4b29-a377-f9a1683e8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:39.138013 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f01660-9008-4b29-a377-f9a1683e8621 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:39.138300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f01660-9008-4b29-a377-f9a1683e8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:39.138576 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f01660-9008-4b29-a377-f9a1683e8621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:39.139308 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f01660-9008-4b29-a377-f9a1683e8621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:39.140918 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f01660-9008-4b29-a377-f9a1683e8621 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:39.151528 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1465/2866] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:39:39.155755 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:39.165751 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7451d11-c305-46d1-a12b-7a0bd45ef279 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:39.170626 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:39.171533 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:39.171808 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:39.172080 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] PATH_INFO: `/v3/projects/e7f152d844fe483381a97afb71103d21/users/f259ace6ba7a4b84ab667b2e3cbb061c/roles/5deb6d93e9c34f3bbfcf82d23e06790e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:39.187879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f152d844fe483381a97afb71103d21, user_id=f259ace6ba7a4b84ab667b2e3cbb061c, role_id=5deb6d93e9c34f3bbfcf82d23e06790e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:39.190625 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:39.304172 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1402/2867] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:39:39 2022] PUT /identity/v3/projects/e7f152d844fe483381a97afb71103d21/users/f259ace6ba7a4b84ab667b2e3cbb061c/roles/5deb6d93e9c34f3bbfcf82d23e06790e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:39.310358 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2f07-1476-4f92-863a-9cae4c37e6fc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:39.310654 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2f07-1476-4f92-863a-9cae4c37e6fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:39.310933 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2f07-1476-4f92-863a-9cae4c37e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:39.330462 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7bac2f07-1476-4f92-863a-9cae4c37e6fc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:39.331782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7bac2f07-1476-4f92-863a-9cae4c37e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:39.394944 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1466/2868] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:39.404419 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:39.406303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:39.464794 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc588-5e25-4021-aefd-58d2552c68d3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:39.469030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:39.469677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:39.469956 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:39.470265 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:39.479391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:39.481367 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:39.492256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1403/2869] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:44.728760 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:44.729300 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:44.730776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:44.769504 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] MFA Rules not processed for user `f259ace6ba7a4b84ab667b2e3cbb061c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:44.770771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:44.855147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1467/2870] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:44.859708 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:44.869939 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee670-557a-4891-abde-5747a6796578 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:44.875355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:44.876155 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:44.876479 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:44.876753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:44.877473 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:44.879503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:44.969440 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1404/2871] 10.222.0.70 () {60 vars in 1152 bytes} [Mon Jun 20 12:39:44 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:39:44.973381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:44.984972 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f0d44-28fa-499b-b587-26d16dfa579b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:44.996010 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:45.058295 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:45.059128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:45.059439 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:45.059782 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:45.060445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:45.062406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:45.144351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1468/2872] 10.222.0.70 () {60 vars in 1143 bytes} [Mon Jun 20 12:39:44 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:39:45.149895 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:45.160075 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958269ee-4ef5-4d81-a5bf-2774fe5bf8e4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:45.169930 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:45.170785 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:45.171137 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:45.171503 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:45.172312 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:45.173963 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:45.195387 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1405/2873] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:39:45.199436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:45.210951 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056d13-204e-4772-bb5e-2a58a1acef63 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:45.219310 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:45.220231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:45.220517 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:45.220797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] PATH_INFO: `/v3/projects/07f00adbf84c4bd591c17aecb07ee6b4/users/47d96a9b7472479f8d67393437116177/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:45.242272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f00adbf84c4bd591c17aecb07ee6b4, user_id=47d96a9b7472479f8d67393437116177, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:45.244973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:45.408346 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1469/2874] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:39:45 2022] PUT /identity/v3/projects/07f00adbf84c4bd591c17aecb07ee6b4/users/47d96a9b7472479f8d67393437116177/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:45.412269 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:45.422541 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7f419-cb18-48af-b428-81a89d583537 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:45.486333 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2708a9b-75bc-4d98-a747-314718d58751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:45.487015 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2708a9b-75bc-4d98-a747-314718d58751 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:45.487303 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2708a9b-75bc-4d98-a747-314718d58751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:45.487586 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2708a9b-75bc-4d98-a747-314718d58751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:45.488313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2708a9b-75bc-4d98-a747-314718d58751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:45.489933 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2708a9b-75bc-4d98-a747-314718d58751 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:45.506475 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1406/2875] 10.222.0.70 () {58 vars in 1121 bytes} [Mon Jun 20 12:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:39:45.508049 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:45.520821 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3bd3f-2fac-43d0-ab4c-1ce26a480c57 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:45.525790 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:45.526731 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:45.531069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:45.531069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] PATH_INFO: `/v3/projects/07f00adbf84c4bd591c17aecb07ee6b4/users/47d96a9b7472479f8d67393437116177/roles/06eae323e9d94a719e6100f2cbfb1003` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:45.531069 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f00adbf84c4bd591c17aecb07ee6b4, user_id=47d96a9b7472479f8d67393437116177, role_id=06eae323e9d94a719e6100f2cbfb1003)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:45.532983 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:45.545081 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1470/2876] 10.222.0.70 () {60 vars in 1482 bytes} [Mon Jun 20 12:39:45 2022] PUT /identity/v3/projects/07f00adbf84c4bd591c17aecb07ee6b4/users/47d96a9b7472479f8d67393437116177/roles/06eae323e9d94a719e6100f2cbfb1003 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:39:51.412838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46bb21-fc06-4f6f-863c-4982af0c7d44 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:51.413754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46bb21-fc06-4f6f-863c-4982af0c7d44 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:51.414171 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46bb21-fc06-4f6f-863c-4982af0c7d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:51.447348 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3a46bb21-fc06-4f6f-863c-4982af0c7d44 None None] MFA Rules not processed for user `47d96a9b7472479f8d67393437116177`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:51.448600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3a46bb21-fc06-4f6f-863c-4982af0c7d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:51.458169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:51.531914 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1407/2877] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:51.547961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:51.550973 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:51.632982 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149ee4-1079-4827-a7d2-a4a9f97fa31c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:51.638865 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd6dcb-26b8-4869-a355-f3e271f51070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:51.639542 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd6dcb-26b8-4869-a355-f3e271f51070 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:51.639803 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd6dcb-26b8-4869-a355-f3e271f51070 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:51.640125 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd6dcb-26b8-4869-a355-f3e271f51070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:51.697068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd6dcb-26b8-4869-a355-f3e271f51070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:39:51.698696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd6dcb-26b8-4869-a355-f3e271f51070 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:39:51.707827 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1471/2878] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:39:54.124144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:54.124673 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:54.124801 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:54.143604 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] MFA Rules not processed for user `f259ace6ba7a4b84ab667b2e3cbb061c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:54.144882 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:54.152052 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1408/2879] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:59.868705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c937-de61-4950-9766-9d3ba66689e4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:59.869235 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c937-de61-4950-9766-9d3ba66689e4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:59.869351 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c937-de61-4950-9766-9d3ba66689e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:39:59.875702 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:59.887672 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f463c937-de61-4950-9766-9d3ba66689e4 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:39:59.888866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f463c937-de61-4950-9766-9d3ba66689e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:39:59.950148 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1472/2880] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:39:59.965949 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:39:59.978501 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9e08-a9b4-4ad9-b111-421b36abdd55 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:39:59.983987 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:39:59.984610 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:39:59.984893 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:39:59.985169 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:00.015369 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:00.016890 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:00.048853 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1409/2881] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:05.064157 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530096-9d89-43e8-8119-e26a688e2cbc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:05.064696 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530096-9d89-43e8-8119-e26a688e2cbc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:05.064893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530096-9d89-43e8-8119-e26a688e2cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:05.140771 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-26530096-9d89-43e8-8119-e26a688e2cbc None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:40:05.141984 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26530096-9d89-43e8-8119-e26a688e2cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:05.150045 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1473/2882] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:40:05.164622 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:05.166144 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:05.198146 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc996e-770a-43a3-a5b1-1bf44ca1de61 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:05.204539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:05.205201 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:05.205492 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:05.205773 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:05.214462 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:05.216177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:05.226768 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1410/2883] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:09.734277 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424699-3ea8-4ae9-8b8b-01d014d0fa5b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:09.734839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424699-3ea8-4ae9-8b8b-01d014d0fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:09.734839 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424699-3ea8-4ae9-8b8b-01d014d0fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:09.760141 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-80424699-3ea8-4ae9-8b8b-01d014d0fa5b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:40:09.761419 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-80424699-3ea8-4ae9-8b8b-01d014d0fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:09.769953 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1474/2884] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:40:09.785125 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:09.796403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549c37-5d16-40c9-9366-c9d3ff72cd40 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:09.802102 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:09.802722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:09.803004 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:09.803278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:09.811313 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:09.812936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:09.823301 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1411/2885] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:13.509786 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:13.510301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:13.510406 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:13.537987 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:40:13.539218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:13.547318 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1475/2886] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:40:13.562429 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:13.574441 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027316eb-7fd2-4c2d-920f-dc9805b64fc3 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:13.580688 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85474e1a-2ba2-4125-a1c1-933969bb5c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:13.581317 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474e1a-2ba2-4125-a1c1-933969bb5c64 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:13.581605 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474e1a-2ba2-4125-a1c1-933969bb5c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:13.581884 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474e1a-2ba2-4125-a1c1-933969bb5c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:13.590218 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85474e1a-2ba2-4125-a1c1-933969bb5c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:13.591804 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85474e1a-2ba2-4125-a1c1-933969bb5c64 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:13.601478 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1412/2887] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:16.209127 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:16.212234 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:16.290749 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a49-c910-4a86-a7d3-710540548261 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:16.294571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:16.295230 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:16.295518 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:16.295797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:16.297567 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:16.308065 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:16.312581 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:16.317677 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1476/2888] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:17.776564 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54af9-5bf0-47ce-8843-8ec53fdd9b52 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:17.777034 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54af9-5bf0-47ce-8843-8ec53fdd9b52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:17.777156 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54af9-5bf0-47ce-8843-8ec53fdd9b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:17.795838 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4ae54af9-5bf0-47ce-8843-8ec53fdd9b52 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:40:17.797035 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4ae54af9-5bf0-47ce-8843-8ec53fdd9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:17.811510 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1413/2889] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:40:17.826272 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:17.839599 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d336d7f-0503-405d-8de6-fd03402cae1b service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:17.845232 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:17.846424 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:17.846715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:17.846998 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:17.855384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:17.857061 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:17.867448 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1477/2890] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:22.043165 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:22.043757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:22.043757 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:22.051355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=80 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:22.067199 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:40:22.068547 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:22.079365 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1414/2891] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:40:22.096445 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:22.100474 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:22.113228 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104eb32-61c0-4697-a74c-90354f9baba0 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:22.119649 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614f14-425f-4320-94e6-5d87149ea930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:22.119798 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614f14-425f-4320-94e6-5d87149ea930 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:22.120024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614f14-425f-4320-94e6-5d87149ea930 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:22.120312 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614f14-425f-4320-94e6-5d87149ea930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:22.129634 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614f14-425f-4320-94e6-5d87149ea930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:22.131158 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614f14-425f-4320-94e6-5d87149ea930 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:22.141842 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1478/2892] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:32.081806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:32.144179 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:38.152452 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:40:38.162932 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234b2a0-907e-4db0-8210-e4e4396a906b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:40:38.166631 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfea14-845d-4190-a6e6-f5775b2cbe13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:40:38.167262 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfea14-845d-4190-a6e6-f5775b2cbe13 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:38.167544 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfea14-845d-4190-a6e6-f5775b2cbe13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:38.167815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfea14-845d-4190-a6e6-f5775b2cbe13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:38.177624 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfea14-845d-4190-a6e6-f5775b2cbe13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:40:38.179093 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfea14-845d-4190-a6e6-f5775b2cbe13 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:40:38.188532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1415/2893] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:40:42.438449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:40:42.438961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:40:42.439101 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:40:42.458062 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] MFA Rules not processed for user `e9a9ac5edcf6467a87b9095abed1b07a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:40:42.459266 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:40:42.514331 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1479/2894] 10.222.0.70 () {58 vars in 957 bytes} [Mon Jun 20 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:40:48.184324 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:52.507422 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=25 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:00.771995 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d64530-db1d-44cf-a289-8ee321229486 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:00.772573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d64530-db1d-44cf-a289-8ee321229486 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:00.772573 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d64530-db1d-44cf-a289-8ee321229486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:00.790253 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f6d64530-db1d-44cf-a289-8ee321229486 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:41:00.792002 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f6d64530-db1d-44cf-a289-8ee321229486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:00.799881 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1416/2895] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:41:00.815573 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:00.830903 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750fd2-27f7-4571-8312-a2f55ed8a456 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:00.836694 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:00.840023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:00.840023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:00.840023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:00.847314 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:00.848939 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:00.859375 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1480/2896] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:41:05.227836 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd35e2-c864-4487-b956-dd756620e906 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:05.228399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd35e2-c864-4487-b956-dd756620e906 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:05.228399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd35e2-c864-4487-b956-dd756620e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:05.246310 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-99fd35e2-c864-4487-b956-dd756620e906 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:41:05.247520 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-99fd35e2-c864-4487-b956-dd756620e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:05.255495 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1417/2897] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:41:05.270733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:05.282866 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fa255-88bc-404c-97f1-ad32e899ea88 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:05.288284 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:05.288915 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:05.289306 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:05.289586 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:05.297674 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:05.300191 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:05.311240 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1481/2898] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:41:09.123047 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f92f-e039-4c44-81ae-5077cd7b6f65 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:09.123526 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f92f-e039-4c44-81ae-5077cd7b6f65 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:09.123646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f92f-e039-4c44-81ae-5077cd7b6f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:09.141923 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b989f92f-e039-4c44-81ae-5077cd7b6f65 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:41:09.143130 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b989f92f-e039-4c44-81ae-5077cd7b6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:09.151098 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1418/2899] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:41:09.166600 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:09.178360 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84a9a-6de8-48f6-9332-1aa746bcebff service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:09.183892 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:09.185084 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:09.185400 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:09.185675 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:09.194856 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:09.196706 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:09.206943 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1482/2900] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:41:13.359790 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce7a54-2ed5-41fe-8e4f-9166892df7b0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:13.360286 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce7a54-2ed5-41fe-8e4f-9166892df7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:13.360405 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce7a54-2ed5-41fe-8e4f-9166892df7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:13.379077 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-19ce7a54-2ed5-41fe-8e4f-9166892df7b0 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:41:13.380264 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-19ce7a54-2ed5-41fe-8e4f-9166892df7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:13.388263 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1419/2901] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:41:13.405294 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:13.416633 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d5e61-c022-4380-8502-8b6f38285dc8 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:13.422699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:13.423335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:13.423627 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:13.423908 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:13.432039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:13.433623 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:13.443847 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1483/2902] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:41:17.613294 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:17.613795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:17.613903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:17.632471 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] MFA Rules not processed for user `59ecf7a36c4a499aaba37cd54ff4117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:41:17.633675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:17.642566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1420/2903] 10.222.0.66 () {58 vars in 1016 bytes} [Mon Jun 20 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:41:17.657690 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:17.668889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5435f-14b0-440e-844d-13444e0c012b service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:17.674379 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:17.675016 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:17.675299 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:17.675574 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:17.683632 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:17.685200 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:17.695068 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1484/2904] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:41:27.627331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=15 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:27.690898 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=30 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:29.010449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:29.011866 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:29.106658 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bacd7-8b09-49f9-89af-69b5c0ac8ce2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:29.111738 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:29.112383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:29.112665 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:29.112940 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:29.114746 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:29.126980 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:29.128566 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:29.138623 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1421/2905] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:41:39.134257 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=41 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:52.847728 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:52.848214 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:52.863218 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38349414-3ac1-49de-bb80-82ad7e37ff7f service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:52.868248 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:52.869121 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:52.869405 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:52.869686 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] PATH_INFO: `/v3/users/e9a9ac5edcf6467a87b9095abed1b07a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:52.870899 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a9ac5edcf6467a87b9095abed1b07a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:52.872819 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:53.058315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a9ac5edcf6467a87b9095abed1b07a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.058873 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a9ac5edcf6467a87b9095abed1b07a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.070572 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a9ac5edcf6467a87b9095abed1b07a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.077538 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a9ac5edcf6467a87b9095abed1b07a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.148532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be3f3a26-4d38-412e-864a-c7538d5c1865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a9ac5edcf6467a87b9095abed1b07a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.155014 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1485/2906] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:41:52 2022] DELETE /identity/v3/users/e9a9ac5edcf6467a87b9095abed1b07a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:41:53.390920 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:53.403271 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377edc-3ed4-4a19-b6a5-7dc2a56779c8 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:53.462660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:53.463589 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:53.463869 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:53.464142 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] PATH_INFO: `/v3/projects/9b4a9334c1f642fb8ed36d6e87d09a01` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:53.465339 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4a9334c1f642fb8ed36d6e87d09a01)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:53.467302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:53.559756 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4a9334c1f642fb8ed36d6e87d09a01', 'request_id': 'req-702266f8-60fd-403e-bbea-c61ba99c6fe7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.566245 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4a9334c1f642fb8ed36d6e87d09a01', 'request_id': 'req-702266f8-60fd-403e-bbea-c61ba99c6fe7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.571795 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4a9334c1f642fb8ed36d6e87d09a01', 'request_id': 'req-702266f8-60fd-403e-bbea-c61ba99c6fe7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.643041 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] The token cache is being invalidate because project 9b4a9334c1f642fb8ed36d6e87d09a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:41:53.643842 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.644455 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:41:53.646046 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1422/2907] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:41:53 2022] DELETE /identity/v3/projects/9b4a9334c1f642fb8ed36d6e87d09a01 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:42:03.151243 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:42:03.639860 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:42:12.599450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:42:12.600556 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:42:12.600645 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:42:12.659185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] MFA Rules not processed for user `868589ee9f3c4265abd3916bfa2266c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:42:12.660381 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:42:12.734733 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1486/2908] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jun 20 12:42:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:42:12.884815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:42:12.886331 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:42:12.977570 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702266f8-60fd-403e-bbea-c61ba99c6fe7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:42:12.982857 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e132b21d8bb426391e00c48f22b9922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:42:12.983500 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:42:12.983786 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:42:12.984072 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:42:12.992231 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:42:12.993772 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:42:13.001855 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1423/2909] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jun 20 12:42:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:42:20.834705 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:42:20.836178 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:42:20.902336 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5266-d433-4faf-9bcb-6176cd4c0559 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:42:20.906872 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:42:20.907738 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:42:20.908027 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:42:20.908311 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] PATH_INFO: `/v3/users/2e8dcd06c87e4907a208bdd8afc3d01c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:42:20.909520 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8dcd06c87e4907a208bdd8afc3d01c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:42:20.911527 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:42:21.054128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8dcd06c87e4907a208bdd8afc3d01c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.054736 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8dcd06c87e4907a208bdd8afc3d01c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.062626 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:42:21.067073 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8dcd06c87e4907a208bdd8afc3d01c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.074133 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8dcd06c87e4907a208bdd8afc3d01c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.198335 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8dcd06c87e4907a208bdd8afc3d01c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.205090 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1487/2910] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:42:20 2022] DELETE /identity/v3/users/2e8dcd06c87e4907a208bdd8afc3d01c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:42:21.492431 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:42:21.504534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ed876-6422-40f0-8b8b-cfee8f9a298e service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:42:21.568069 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:42:21.569375 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:42:21.569660 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:42:21.569938 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] PATH_INFO: `/v3/projects/6db23e9dae4646baabaed28a874a2fd7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:42:21.571176 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db23e9dae4646baabaed28a874a2fd7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:42:21.573374 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:42:21.729706 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db23e9dae4646baabaed28a874a2fd7', 'request_id': 'req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.735919 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db23e9dae4646baabaed28a874a2fd7', 'request_id': 'req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.741346 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db23e9dae4646baabaed28a874a2fd7', 'request_id': 'req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.804832 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:42:21.808753 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] The token cache is being invalidate because project 6db23e9dae4646baabaed28a874a2fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:42:21.809044 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.809675 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:21.811278 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1424/2911] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:42:21 2022] DELETE /identity/v3/projects/6db23e9dae4646baabaed28a874a2fd7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:42:21.815398 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:42:21.816855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:42:21.831024 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0c5db-063f-4115-bd4a-fdd5b814810f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:42:21.887435 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:42:21.888347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:42:21.888665 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:42:21.888946 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] PATH_INFO: `/v3/users/8c6bb9d3674c49e7aaacfc65f52ec95d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:42:21.890249 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6bb9d3674c49e7aaacfc65f52ec95d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:42:21.892177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:42:22.051102 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6bb9d3674c49e7aaacfc65f52ec95d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.051855 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6bb9d3674c49e7aaacfc65f52ec95d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.063893 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6bb9d3674c49e7aaacfc65f52ec95d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.071237 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6bb9d3674c49e7aaacfc65f52ec95d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.153952 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6bb9d3674c49e7aaacfc65f52ec95d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.160446 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1488/2912] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:42:21 2022] DELETE /identity/v3/users/8c6bb9d3674c49e7aaacfc65f52ec95d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:42:22.567177 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:42:22.569299 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:42:22.584700 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad6595-bd03-4e22-9a17-9e3ccd6f4989 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:42:22.641391 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:42:22.642274 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:42:22.642558 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:42:22.642837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] PATH_INFO: `/v3/projects/6ad5066ad5b94af39a73487d1d6ab854` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:42:22.644016 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad5066ad5b94af39a73487d1d6ab854)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:42:22.645950 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:42:22.760356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad5066ad5b94af39a73487d1d6ab854', 'request_id': 'req-c72c8005-6e3f-4d42-b58f-0d6396235030'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.766424 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad5066ad5b94af39a73487d1d6ab854', 'request_id': 'req-c72c8005-6e3f-4d42-b58f-0d6396235030'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.772710 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad5066ad5b94af39a73487d1d6ab854', 'request_id': 'req-c72c8005-6e3f-4d42-b58f-0d6396235030'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.850449 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] The token cache is being invalidate because project 6ad5066ad5b94af39a73487d1d6ab854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:42:22.850677 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.851302 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:42:22.852886 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1425/2913] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:42:22 2022] DELETE /identity/v3/projects/6ad5066ad5b94af39a73487d1d6ab854 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:42:32.156715 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=61,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:42:32.847175 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:21.480428 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:43:21.481878 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:21.538671 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daab7d-b802-4f18-a183-3d826ac35cd6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:43:21.586177 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:43:21.586824 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:43:21.587107 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:43:21.587384 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:43:21.589128 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:21.669136 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:43:21.670604 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:43:21.690699 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1489/2914] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:43:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:43:27.525352 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:43:27.526825 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:27.539719 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8005-6e3f-4d42-b58f-0d6396235030 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:43:27.543334 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:43:27.543971 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:43:27.544256 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:43:27.544534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:43:27.546344 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:27.560074 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:43:27.561539 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:43:27.573202 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1426/2915] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:43:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:43:30.419889 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:43:30.422039 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:30.435224 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823ad5-5c48-4643-abc2-052ca3c2ad84 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:43:30.439188 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:43:30.439880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:43:30.440256 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:43:30.440548 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:43:30.443458 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:30.454928 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:43:30.456961 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:43:30.466536 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1490/2916] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:43:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:43:30.544402 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:43:30.553356 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532426eb-73fb-4569-9f29-0b8e0e9c6ead service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:43:30.557061 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:43:30.557693 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:43:30.558022 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:43:30.563667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:43:30.563667 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:43:30.574532 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:43:30.575854 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:43:30.587383 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1427/2917] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:43:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:43:40.462822 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:40.582628 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=12 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:44:14.546052 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:44:14.555553 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2e2b-8763-4b8a-8636-6f8c27bf4e01 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:44:14.559142 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:44:14.559776 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:44:14.560087 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:44:14.560362 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:44:14.562135 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:44:14.572238 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:44:14.573646 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:44:14.581830 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1491/2918] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:44:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:44:24.578301 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:16.729984 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:16.738903 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6f16f-0a07-4ac8-98eb-41ddcaf31753 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:16.742534 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:16.743173 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:16.743460 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:16.743741 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:16.745498 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:16.803722 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:16.805178 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:16.816806 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1428/2919] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:45:17.749571 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:17.753364 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:17.768162 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4942cb-a2c4-4517-a94e-c505de570def service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:17.774147 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f73e12101d42c9b94d8b19ec555055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:17.774797 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:17.775088 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:17.775370 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:17.777750 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:17.791643 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:17.793532 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:17.806030 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1492/2920] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:45:21.946600 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:21.955815 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80d5f-991a-43d1-b93f-575d4beb6f40 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:21.960111 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db4109ed2c6485eb033cb10eee8e67b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:21.960747 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:21.961030 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:21.961305 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:21.963114 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:22.026465 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:22.027957 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:22.038246 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1429/2921] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:45:25.481012 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:25.482487 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:25.551091 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f012d-93c8-4a9f-a5a0-a7e1fcf65841 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:25.556525 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:25.561043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:25.561043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:25.561043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:25.561043 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:25.571838 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:25.573436 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:25.583664 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1493/2922] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:45:28.740276 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:28.752698 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ceaf-fd66-4908-b492-7cb7eb8fbe99 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:28.758577 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:28.759212 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:28.759525 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:28.759829 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:28.761585 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:28.773669 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:28.775355 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:28.785916 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1430/2923] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:45:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:45:28.892756 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:28.894469 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:28.908304 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66580fa-8c91-4964-890e-df348cd0650f service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:28.913347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:28.914258 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:28.914547 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:28.914828 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] PATH_INFO: `/v3/users/f259ace6ba7a4b84ab667b2e3cbb061c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:28.916023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f259ace6ba7a4b84ab667b2e3cbb061c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:28.917960 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:29.112144 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f259ace6ba7a4b84ab667b2e3cbb061c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.112748 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f259ace6ba7a4b84ab667b2e3cbb061c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.125762 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f259ace6ba7a4b84ab667b2e3cbb061c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.132754 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f259ace6ba7a4b84ab667b2e3cbb061c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.200450 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f259ace6ba7a4b84ab667b2e3cbb061c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.209880 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1494/2924] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:45:28 2022] DELETE /identity/v3/users/f259ace6ba7a4b84ab667b2e3cbb061c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:45:29.481837 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:29.495319 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bf16f-6df9-4665-afef-267c1a98522f service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:29.549754 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:29.550646 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:29.550936 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:29.551210 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] PATH_INFO: `/v3/projects/e7f152d844fe483381a97afb71103d21` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:29.552399 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f152d844fe483381a97afb71103d21)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:29.554403 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:29.577065 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:29.679739 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f152d844fe483381a97afb71103d21', 'request_id': 'req-33a74bcc-bdc0-4a64-8712-0a31b1080346'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.685879 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f152d844fe483381a97afb71103d21', 'request_id': 'req-33a74bcc-bdc0-4a64-8712-0a31b1080346'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.691401 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f152d844fe483381a97afb71103d21', 'request_id': 'req-33a74bcc-bdc0-4a64-8712-0a31b1080346'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.770796 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] The token cache is being invalidate because project e7f152d844fe483381a97afb71103d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:45:29.771393 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.771671 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:29.773759 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1431/2925] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:45:29 2022] DELETE /identity/v3/projects/e7f152d844fe483381a97afb71103d21 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:45:29.777862 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:29.779390 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:29.792580 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d4957-e482-4686-8dbc-738092273016 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:29.838023 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:29.849552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:29.850454 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:29.850744 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:29.851058 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] PATH_INFO: `/v3/users/47d96a9b7472479f8d67393437116177` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:29.852222 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d96a9b7472479f8d67393437116177)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:29.854185 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:30.063621 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d96a9b7472479f8d67393437116177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.064262 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d96a9b7472479f8d67393437116177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.077192 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d96a9b7472479f8d67393437116177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.084078 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d96a9b7472479f8d67393437116177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.152524 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d96a9b7472479f8d67393437116177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.159022 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1495/2926] 10.222.0.70 () {58 vars in 1223 bytes} [Mon Jun 20 12:45:29 2022] DELETE /identity/v3/users/47d96a9b7472479f8d67393437116177 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:45:30.403104 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:45:30.404237 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:45:30.420659 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74bcc-bdc0-4a64-8712-0a31b1080346 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:45:30.480291 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ecf7a36c4a499aaba37cd54ff4117a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5236866843c24c419599ba663dbbb1be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:45:30.481160 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:45:30.481425 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:45:30.481701 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] PATH_INFO: `/v3/projects/07f00adbf84c4bd591c17aecb07ee6b4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:45:30.482917 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f00adbf84c4bd591c17aecb07ee6b4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:45:30.484887 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:45:30.571559 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f00adbf84c4bd591c17aecb07ee6b4', 'request_id': 'req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.577926 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f00adbf84c4bd591c17aecb07ee6b4', 'request_id': 'req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.583472 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f00adbf84c4bd591c17aecb07ee6b4', 'request_id': 'req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.654166 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] The token cache is being invalidate because project 07f00adbf84c4bd591c17aecb07ee6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:45:30.654451 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.655120 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ee8d08e-1b21-4271-b8fe-b508f14d0e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:45:30.656758 dv-cinder-836973-4-smb devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1432/2927] 10.222.0.70 () {58 vars in 1232 bytes} [Mon Jun 20 12:45:30 2022] DELETE /identity/v3/projects/07f00adbf84c4bd591c17aecb07ee6b4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:45:40.155347 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:40.651014 dv-cinder-836973-4-smb devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:14.142879 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:47:14.144315 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:47:14.213432 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6ae51-1894-4629-b4f3-4123862cb7be admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:47:14.271478 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c51168ff1c1f42e781051ace1af97dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8784149a72314664ba0a379404d0c257', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:47:14.272159 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:47:14.272449 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:47:14.272732 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:47:14.274552 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:47:14.286361 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:47:14.287948 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38226-5dbc-4a8f-b6e8-19cd7b9aee86 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:47:14.298616 dv-cinder-836973-4-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1496/2928] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jun 20 12:47:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:47:24.294231 dv-cinder-836973-4-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=58 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}